Sep 29 12:25:16 devstack cinder-volume[75778]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 12:25:16 devstack cinder-volume[75778]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 12:25:16 devstack cinder-volume[75778]: we strongly recommend against using it for new projects. Sep 29 12:25:16 devstack cinder-volume[75778]: If you are already using Eventlet, we recommend migrating to a different Sep 29 12:25:16 devstack cinder-volume[75778]: framework. For more detail see Sep 29 12:25:16 devstack cinder-volume[75778]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 12:25:16 devstack cinder-volume[75778]: import eventlet # noqa Sep 29 12:25:18 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:25:18 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:25:18 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:25:20 devstack cinder-volume[75778]: INFO dbcounter [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Registered counter for database cinder Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG dbcounter [-] [75778] Writer thread running {{(pid=75778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:25:20 devstack cinder-volume[75778]: INFO cinder.rpc [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 12:25:20 devstack cinder-volume[75778]: INFO cinder.rpc [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:25:20 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Determined volume DB was empty at startup. Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG cinder.volume.manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75778) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 12:25:20 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 12:25:20 devstack cinder-volume[75778]: WARNING stevedore.named [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 12:25:20 devstack cinder-volume[75778]: WARNING castellan.key_manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:25:20 devstack cinder-volume[75778]: WARNING cinder.keymgr.conf_key_mgr [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG cinder.volume.drivers.lvm [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75778) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 29 12:25:20 devstack cinder-volume[75778]: DEBUG oslo_concurrency.processutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_concurrency.processutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=75778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:25:21 devstack cinder-volume[75778]: INFO cinder.rpc [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 29 12:25:21 devstack cinder-volume[75778]: INFO cinder.rpc [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 29 12:25:21 devstack cinder-volume[75778]: WARNING stevedore.named [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 12:25:21 devstack cinder-volume[75778]: WARNING castellan.key_manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:25:21 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:25:21 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Starting 1 workers Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Started child 75949 {{(pid=75778) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Full set of CONF: {{(pid=75778) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] ******************************************************************************** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Configuration options gathered from: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] ================================================================================ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] allow_availability_zone_fallback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75949]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] allow_compression_on_image_upload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] allowed_direct_url_schemes = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] api_rate_limit = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] auth_strategy = keystone {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] az_cache_duration = 3600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_host = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_stats_polling_interval = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backup_api_class = cinder.backup.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backup_name_template = backup-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backup_use_same_host = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backup_use_temp_snapshot = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] chap_username = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_internal_tenant_project_id = 28e169f7cf8d4815aba814d72c6d3a77 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_internal_tenant_user_id = bccb347a6a1f4488866bb7fbf4f3457d {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cloned_volume_same_az = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cluster = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] compression_format = gzip {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] compute_api_class = cinder.compute.nova.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] config_dir = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] config_source = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] control_exchange = openstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] debug = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] default_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] default_group_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] default_volume_type = lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_ssl_cert_verify = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] driver_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] enable_force_upload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] enable_new_services = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] enable_unsupported_driver = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] enforce_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_api_insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_api_ssl_compression = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_ca_certificates_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_catalog_info = image:glance:publicURL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_num_retries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance_request_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] graceful_shutdown_timeout = 5 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] group_api_class = cinder.group.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] host = devstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_compress_on_upload = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_conversion_address_space_limit = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_conversion_cpu_limit = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_conversion_disable = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_introspection_address_space_limit = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_introspection_cpu_limit = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_upload_use_cinder_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_upload_use_internal_tenant = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_volume_cache_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_volume_cache_max_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] image_volume_cache_max_size_gb = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] init_host_max_objects_retrieval = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] instance_format = [instance: %(uuid)s] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iscsi_target_flags = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iscsi_write_cache = on {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iser_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iser_ip_address = 192.168.122.201 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iser_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_color = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_config_append = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_options = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_rotate_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_rotate_interval_type = days {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] log_rotation_type = none {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] max_age = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] max_logfile_count = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] max_logfile_size_mb = 200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] max_over_subscription_ratio = 20.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] message_reap_interval = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] message_ttl = 2592000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] migration_create_volume_timeout_secs = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] monkey_patch = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] monkey_patch_modules = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] my_ip = 192.168.122.201 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] no_snapshot_gb_quota = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] num_iser_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] num_shell_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] num_volume_device_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] nvmeof_conn_info_version = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] nvmet_ns_id = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] nvmet_port_id = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_max_limit = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_ext_list = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_listen_port = 8776 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] osapi_volume_workers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] per_volume_size_limit = -1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] periodic_fuzzy_delay = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] periodic_interval = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] public_endpoint = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] publish_errors = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_backup_gigabytes = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_backups = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_gigabytes = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_groups = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_snapshots = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] quota_volumes = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] rate_limit_burst = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] rate_limit_except_level = CRITICAL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] rate_limit_interval = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] reinit_driver_count = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] report_discard_supported = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] report_interval = 120 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] reservation_clean_interval = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] reservation_expire = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] reserved_image_namespaces = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] reserved_percentage = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] rpc_response_timeout = 120 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] run_external_periodic_tasks = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] scst_target_driver = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_down_time = 720 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] shell_completion = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] snapshot_name_template = snapshot-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] snapshot_same_host = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] state_path = /opt/stack/data/cinder {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] storage_availability_zone = nova {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] storage_protocol = iSCSI {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] syslog_log_facility = LOG_USER {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_helper = lioadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_ip_address = 192.168.122.201 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] target_secondary_ip_addresses = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] transport_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] until_refresh = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_chap_auth = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_default_quota_class = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_journal = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_json = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_stderr = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] use_syslog = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] verify_glance_signatures = enabled {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_api_class = cinder.volume.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_clear_size = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_copy_bps_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_dd_blocksize = 1M {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_name_template = volume-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_service_inithost_offload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volume_usage_audit_period = month {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] zoning_mode = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_concurrency.disable_process_locking = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.auth_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.cache = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.include_service_catalog = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.interface = public {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcache_username = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.service_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.062s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.backend = dogpile.cache.null {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.backend_argument = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.backend_expiration_time = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.config_prefix = cache.oslo {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.debug_cache_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.enable_retry_client = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.enable_socket_keepalive = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.expiration_time = 600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.hashclient_retry_attempts = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_dead_retry = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_pool_maxsize = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_sasl_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.proxies = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.redis_db = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.redis_server = localhost:6379 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.retry_attempts = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.retry_delay = 0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.socket_keepalive_count = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.socket_keepalive_idle = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.socket_keepalive_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.socket_timeout = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.tls_allowed_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.tls_cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.tls_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.tls_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.tls_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cache.username = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] coordination.backend_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.asyncio_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.asyncio_slave_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.backend = sqlalchemy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.connection_debug = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.connection_parameters = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.connection_recycle_time = 3600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.connection_trace = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.db_inc_retry_interval = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.db_max_retries = 20 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.db_max_retry_interval = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.db_retry_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.max_overflow = 50 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.max_pool_size = 5 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.max_retries = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.mysql_wsrep_sync_wait = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.pool_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.retry_interval = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.slave_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.sqlite_synchronous = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.synchronous_reader = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] database.use_db_reconnect = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_tracing.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.connection_string = messaging:// {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.es_doc_type = notification {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.es_scroll_size = 10000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.es_scroll_time = 2m {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.filter_error_trace = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.hmac_keys = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.sentinel_service_name = mymaster {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.socket_timeout = 0.1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.trace_requests = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler.trace_sqlalchemy = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler_jaeger.process_tags = {} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler_jaeger.service_name_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] profiler_otlp.service_name_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.enforce_new_defaults = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.policy_default_rule = default {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.policy_file = policy.yaml {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.group = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.helper_command = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] privsep_osbrick.user = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.group = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.helper_command = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] cinder_sys_admin.user = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.send_service_user_token = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.tls_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] service_user.tls_min_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.tls_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] glance.tls_min_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.chap_username = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.driver_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.extra_capabilities = {} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iscsi_target_flags = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iscsi_write_cache = on {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iser_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iser_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.lvm_share_target = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.lvm_type = auto {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.num_shell_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.report_discard_supported = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.reserved_percentage = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.unique_fqdn_network = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.use_chap_auth = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_clear_size = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_reports.file_event_handler = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_reports.log_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.backend_host = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.chap_username = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.extra_capabilities = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iser_helper = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iser_ip_address = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iser_port = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.lvm_share_target = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.lvm_type = auto {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.num_shell_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack sudo[75992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.report_discard_supported = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack sudo[75992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.reserved_percentage = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.scst_target_driver = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.storage_protocol = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_helper = lioadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_ip_address = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.use_chap_auth = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_clear_size = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] lvmdriver-1.volumes_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_notifications.driver = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_notifications.retry = -1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] key_manager.fixed_key = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.barbican_api_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.barbican_endpoint = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.barbican_endpoint_type = public {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.barbican_region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.number_of_retries = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.retry_delay = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.send_service_user_token = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.tls_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.tls_min_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.verify_ssl = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican.verify_ssl_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.auth_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.tls_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] barbican_service_user.tls_min_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.approle_role_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.approle_secret_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.auth_method = approle {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.auth_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.kv_mountpoint = secret {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.kv_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.kv_version = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.root_token_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.ssl_ca_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.token_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.token_role = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:25:21 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] ******************************************************************************** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 12:25:21 devstack sudo[75992]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:21 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:21 devstack sudo[76101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:21 devstack sudo[76101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:22 devstack sudo[76101]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.405s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:25:22 devstack cinder-volume[75949]: INFO cinder.brick.local_dev.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:22 devstack sudo[76212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:22 devstack sudo[76212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:22 devstack sudo[76212]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG cinder.brick.local_dev.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75949) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 29 12:25:22 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:22 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:22 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:23 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.534s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:23 devstack sudo[76534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:23 devstack sudo[76534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:23 devstack sudo[76534]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:23 devstack sudo[76564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 29 12:25:23 devstack sudo[76564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:23 devstack sudo[76564]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.359s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:23 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:23 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:23 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:24 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:24 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:24 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:24 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:24 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:24 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:24 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:24 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:24 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:24 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:25 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:25 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:25 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: INFO cinder.volume.drivers.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:25 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:25 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:25 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:25 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:25 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:25 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:25 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:26 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:26 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:26 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:26 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:26 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:26 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:26 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:26 devstack cinder-volume[75949]: INFO cinder.volume.driver [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG cinder.volume.driver [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75949) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_db.sqlalchemy.engines [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75949) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writer thread running {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG cinder.db.api [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Building query based on filter {{(pid=75949) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG cinder.image.image_utils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75949) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 12:25:26 devstack cinder-volume[75949]: INFO cinder.keymgr.migration [None req-b6092772-0500-4917-be33-f50d00c68334 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:25:26 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:26 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:26 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:27 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:27 devstack sudo[76777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:27 devstack sudo[76777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:27 devstack sudo[76777]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:27 devstack sudo[76781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:27 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:27 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:27 devstack sudo[76784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:27 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:28 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:25:28 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Driver initialization completed successfully. Sep 29 12:25:28 devstack cinder-volume[75949]: INFO cinder.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Initiating service 2 cleanup Sep 29 12:25:28 devstack cinder-volume[75949]: INFO cinder.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Service 2 cleanup completed. Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG cinder.service [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Creating RPC server for service cinder-volume {{(pid=75949) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG cinder.service [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75949) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 12:25:28 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:28 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:25:28 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:28 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:28 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:28 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:28 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:28 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:28 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:25:28 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:29 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:29 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:29 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:25:29 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:25:29 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:25:29 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Sep 29 12:25:29 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:25:29 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-c5cae78d-c53b-4a2d-a0cb-67fa8f860762 None None] Driver post RPC initialization completed successfully. Sep 29 12:25:31 devstack cinder-volume[75778]: DEBUG dbcounter [-] [75778] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:25:38 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=3 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:25:39 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:26:07 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:26:07 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:26:07 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread info: [<_MainThread(MainThread, started 129625518821504)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:27:07 devstack sudo[81908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:27:07 devstack sudo[81908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:27:07 devstack sudo[81908]: pam_unix(sudo:session): session closed for user root Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:27:07 devstack sudo[81912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:27:07 devstack sudo[81912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:27:07 devstack sudo[81912]: pam_unix(sudo:session): session closed for user root Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:27:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:27:08 devstack sudo[81915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:27:08 devstack sudo[81915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:27:08 devstack sudo[81915]: pam_unix(sudo:session): session closed for user root Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:27:08 devstack sudo[81918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:27:08 devstack sudo[81918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:27:08 devstack sudo[81918]: pam_unix(sudo:session): session closed for user root Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:27:08 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread info: [<_MainThread(MainThread, started 129625518821504)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:27:39 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:27:39 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:28:07 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:28:07 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:28:07 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:28:07 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:28:07 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:28:07 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:28:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:28:08 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:28:08 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:28:08 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Sep 29 12:28:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:28:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:28:08 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:28:08 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:28:08 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Sep 29 12:28:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:28:08 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:29:07 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:29:07 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 12:29:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:29:07 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 12:29:07 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:29:07 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Sep 29 12:29:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:29:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:29:07 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:29:07 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:29:08 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:29:08 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 12:29:08 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:29:08 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:29:08 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 12:29:08 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:29:08 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:29:08 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-87a77bf9-49fb-46a7-bdaf-0d1092c2ffee None None] thread info: [<_MainThread(MainThread, started 129625518821504)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:29:39 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:29:39 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:29:53 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Caught SIGTERM, stopping children Sep 29 12:29:53 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Acquiring lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:29:53 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Acquired lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:29:53 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Releasing lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:29:53 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Stop services. {{(pid=75778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 12:29:53 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Killing children. {{(pid=75778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 12:29:53 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Waiting on 1 children to exit Sep 29 12:29:58 devstack cinder-volume[75949]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 29 12:29:59 devstack cinder-volume[85871]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 12:29:59 devstack cinder-volume[85871]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 12:29:59 devstack cinder-volume[85871]: we strongly recommend against using it for new projects. Sep 29 12:29:59 devstack cinder-volume[85871]: If you are already using Eventlet, we recommend migrating to a different Sep 29 12:29:59 devstack cinder-volume[85871]: framework. For more detail see Sep 29 12:29:59 devstack cinder-volume[85871]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 12:29:59 devstack cinder-volume[85871]: import eventlet # noqa Sep 29 12:30:01 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:30:01 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:30:01 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:30:01 devstack cinder-volume[85871]: INFO dbcounter [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Registered counter for database cinder Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_db.sqlalchemy.engines [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG dbcounter [-] [85871] Writer thread running {{(pid=85871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:30:02 devstack cinder-volume[85871]: INFO cinder.rpc [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 12:30:02 devstack cinder-volume[85871]: INFO cinder.rpc [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_db.sqlalchemy.engines [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:02 devstack cinder-volume[85871]: INFO cinder.volume.manager [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Determined volume DB was empty at startup. Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG cinder.volume.manager [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85871) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 12:30:02 devstack cinder-volume[85871]: INFO cinder.volume.manager [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 12:30:02 devstack cinder-volume[85871]: WARNING stevedore.named [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 12:30:02 devstack cinder-volume[85871]: WARNING castellan.key_manager [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:30:02 devstack cinder-volume[85871]: WARNING cinder.keymgr.conf_key_mgr [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:30:02 devstack cinder-volume[85871]: INFO cinder.volume.manager [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_db.sqlalchemy.engines [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:02 devstack cinder-volume[85871]: INFO oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Starting 1 workers Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Started child 86088 {{(pid=85871) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Full set of CONF: {{(pid=85871) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] ******************************************************************************** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Configuration options gathered from: {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] ================================================================================ {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] allow_availability_zone_fallback = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] allow_compression_on_image_upload = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] allowed_direct_url_schemes = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] api_rate_limit = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] auth_strategy = keystone {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_availability_zone = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_host = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_stats_polling_interval = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backup_api_class = cinder.backup.api.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backup_name_template = backup-%s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backup_use_same_host = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backup_use_temp_snapshot = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] chap_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] chap_username = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[86088]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_internal_tenant_project_id = 28e169f7cf8d4815aba814d72c6d3a77 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_internal_tenant_user_id = bccb347a6a1f4488866bb7fbf4f3457d {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cluster = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] compression_format = gzip {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] config_dir = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] config_source = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] control_exchange = openstack {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] debug = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] default_availability_zone = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] default_group_type = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] default_volume_type = QuobyteHD {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] disk_geometry = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_client_cert = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_client_cert_key = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_data_namespace = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_ssl_cert_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_ssl_cert_verify = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] driver_use_ssl = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] enable_new_services = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] enable_unsupported_driver = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] enforce_multipath_for_image_xfer = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] filter_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_api_insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_api_ssl_compression = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_ca_certificates_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_num_retries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance_request_timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] goodness_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] graceful_shutdown_timeout = 5 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] group_api_class = cinder.group.api.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] host = devstack {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_compress_on_upload = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_conversion_address_space_limit = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_conversion_cpu_limit = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_conversion_disable = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_introspection_address_space_limit = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_introspection_cpu_limit = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_upload_use_cinder_backend = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_upload_use_internal_tenant = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_volume_cache_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_volume_cache_max_count = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] init_host_max_objects_retrieval = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] instance_format = [instance: %(uuid)s] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iscsi_target_flags = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iscsi_write_cache = on {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iser_helper = tgtadm {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iser_ip_address = 192.168.122.201 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iser_port = 3260 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_color = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_config_append = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_dir = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_options = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_rotate_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_rotate_interval_type = days {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] log_rotation_type = none {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] max_age = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] max_logfile_count = 30 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] max_logfile_size_mb = 200 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] max_over_subscription_ratio = 20.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] message_reap_interval = 86400 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] message_ttl = 2592000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] monkey_patch = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] monkey_patch_modules = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] my_ip = 192.168.122.201 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] no_snapshot_gb_quota = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] num_iser_scan_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] num_shell_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] num_volume_device_scan_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] nvmeof_conn_info_version = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] nvmet_ns_id = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] nvmet_port_id = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_max_limit = 1000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_ext_list = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_listen_port = 8776 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_use_ssl = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] osapi_volume_workers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] per_volume_size_limit = -1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] periodic_fuzzy_delay = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] periodic_interval = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] public_endpoint = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] publish_errors = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_backup_gigabytes = 1000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_backups = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_gigabytes = 1000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_groups = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_snapshots = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] quota_volumes = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] rate_limit_burst = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] rate_limit_except_level = CRITICAL {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] rate_limit_interval = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] reinit_driver_count = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] replication_device = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] report_discard_supported = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] report_interval = 120 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] reservation_clean_interval = 86400 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] reservation_expire = 86400 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] reserved_image_namespaces = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] reserved_percentage = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] rpc_response_timeout = 120 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] run_external_periodic_tasks = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] scst_target_driver = iscsi {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] scst_target_iqn_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_down_time = 720 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] shell_completion = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] snapshot_name_template = snapshot-%s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] split_loggers = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] state_path = /opt/stack/data/cinder {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] storage_availability_zone = nova {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] storage_protocol = iSCSI {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] syslog_log_facility = LOG_USER {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_helper = lioadm {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_ip_address = 192.168.122.201 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_port = 3260 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_protocol = iscsi {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] target_secondary_ip_addresses = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] trace_flags = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] transport_url = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] until_refresh = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_chap_auth = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_default_quota_class = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_journal = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_json = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_multipath_for_image_xfer = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_stderr = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] use_syslog = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] verify_glance_signatures = enabled {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_api_class = cinder.volume.api.API {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_backend_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_clear = zero {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_clear_ionice = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_clear_size = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_copy_bps_limit = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_dd_blocksize = 1M {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_name_template = volume-%s {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_service_inithost_offload = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volume_usage_audit_period = month {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] zoning_mode = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.auth_section = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.auth_type = password {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.auth_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.cache = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[86088]: INFO cinder.volume.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.interface = public {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.remotefs [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86088) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcache_username = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.region_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.service_type = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.backend = dogpile.cache.null {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.backend_argument = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.backend_expiration_time = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.config_prefix = cache.oslo {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.debug_cache_backend = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.enable_retry_client = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.enable_socket_keepalive = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.expiration_time = 600 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_dead_retry = 300 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_sasl_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.proxies = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.redis_db = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.redis_server = localhost:6379 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.retry_attempts = 2 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.retry_delay = 0.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.socket_keepalive_count = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.socket_keepalive_idle = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.socket_keepalive_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.socket_timeout = 1.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.tls_allowed_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.tls_cafile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.tls_certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.tls_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.tls_keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cache.username = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] coordination.backend_url = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.asyncio_connection = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.asyncio_slave_connection = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.backend = sqlalchemy {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.connection = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.connection_debug = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.connection_parameters = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.connection_recycle_time = 3600 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.connection_trace = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.db_inc_retry_interval = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.db_max_retries = 20 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.db_max_retry_interval = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.db_retry_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.max_overflow = 50 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.max_pool_size = 5 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.max_retries = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.pool_timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.retry_interval = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.slave_connection = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.sqlite_synchronous = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.synchronous_reader = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] database.use_db_reconnect = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_tracing.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.connection_string = messaging:// {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.es_doc_type = notification {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.es_scroll_size = 10000 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.es_scroll_time = 2m {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.filter_error_trace = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.hmac_keys = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.sentinel_service_name = mymaster {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.socket_timeout = 0.1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.trace_requests = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler.trace_sqlalchemy = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler_jaeger.process_tags = {} {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] profiler_otlp.service_name_prefix = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.policy_default_rule = default {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.group = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.helper_command = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] privsep_osbrick.user = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.group = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.helper_command = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] cinder_sys_admin.user = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.auth_section = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.auth_type = password {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.cafile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.collect_timing = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.send_service_user_token = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.split_loggers = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.tls_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] service_user.tls_min_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.auth_section = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.auth_type = password {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.collect_timing = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.region_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.split_loggers = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.tls_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] glance.tls_min_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.backend_availability_zone = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.chap_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.chap_username = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.disk_geometry = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_client_cert = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_data_namespace = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.driver_use_ssl = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.extra_capabilities = {} {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.filter_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.goodness_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iscsi_target_flags = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iser_port = 3260 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_host = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_login = admin {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_mount_options = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_private_key = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_share_path = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.replication_device = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.report_discard_supported = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_helper = tgtadm {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_port = 3260 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_protocol = iscsi {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.trace_flags = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.use_chap_auth = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_backend_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_clear = zero {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_reports.file_event_handler = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_reports.log_dir = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.backend_host = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.chap_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86088) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 12:30:02 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.chap_username = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:02 devstack cinder-volume[86088]: WARNING cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[86088]: WARNING cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.disk_geometry = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_client_cert = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Running cmd (subprocess): mount.quobyte {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.extra_capabilities = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.filter_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.goodness_function = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iser_helper = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iser_ip_address = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iser_port = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_host = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_login = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_mount_options = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_password = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_private_key = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_share_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.num_shell_tries = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.replication_device = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.report_discard_supported = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.reserved_percentage = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.scst_target_driver = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.storage_protocol = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_helper = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_ip_address = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_port = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_prefix = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_protocol = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.trace_flags = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.use_chap_auth = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_clear = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_clear_size = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] QuobyteHD.volumes_dir = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_notifications.driver = [] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] key_manager.fixed_key = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.barbican_api_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.barbican_endpoint = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.barbican_endpoint_type = public {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.barbican_region_name = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.cafile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.collect_timing = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.number_of_retries = 60 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.retry_delay = 1 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.send_service_user_token = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.split_loggers = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.tls_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.tls_min_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.verify_ssl = True {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican.verify_ssl_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.auth_section = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.auth_type = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.cafile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.certfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.collect_timing = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.insecure = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.keyfile = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.split_loggers = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.timeout = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.tls_ciphers = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] barbican_service_user.tls_min_version = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.approle_role_id = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.approle_secret_id = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.auth_method = approle {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.auth_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.kv_mountpoint = secret {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.kv_path = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.kv_version = 2 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.namespace = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.root_token_id = **** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.ssl_ca_crt_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.timeout = 60.0 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.token_file = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.token_role = None {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.use_ssl = False {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:03 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] ******************************************************************************** {{(pid=85871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 12:30:03 devstack quobyte-client[86092]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 12:30:03 devstack quobyte-client[86092]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] CMD "mount.quobyte" returned: 1 in 0.123s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86088) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:03 devstack cinder-volume[86088]: INFO cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 ... Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f -c /etc/quobyte/client-cinder.cfg {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:03 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f -c /etc/quobyte/client-cinder.cfg Sep 29 12:30:03 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Acquiring lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:30:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Acquired lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:30:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Releasing lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:30:03 devstack cinder-volume[75949]: WARNING amqp [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 12:30:03 devstack cinder-volume[75949]: WARNING amqp [None req-a7325e6e-d892-4f9c-92a2-be451a6d8133 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 12:30:03 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.468s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:03 devstack cinder-volume[86088]: INFO cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 succeeded Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86088) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:03 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:03 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:03 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.253s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:03 devstack cinder-volume[86088]: INFO cinder.volume.driver [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.volume.driver [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0428924560547, 'free_capacity_gb': 1775.0428924560547, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86088) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_db.sqlalchemy.engines [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86088) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG dbcounter [-] [86088] Writer thread running {{(pid=86088) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.db.api [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Building query based on filter {{(pid=86088) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.image.image_utils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86088) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 12:30:03 devstack cinder-volume[86088]: INFO cinder.keymgr.migration [None req-701c75cf-bb94-4474-a88c-3c7c9a1ae9bd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:03 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86088) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86088) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:04 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:04 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:04 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.443s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Notifying Schedulers of capabilities ... {{(pid=86088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:30:04 devstack cinder-volume[86088]: INFO cinder.volume.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Driver initialization completed successfully. Sep 29 12:30:04 devstack cinder-volume[86088]: INFO cinder.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Initiating service 3 cleanup Sep 29 12:30:04 devstack cinder-volume[86088]: INFO cinder.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Service 3 cleanup completed. Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.service [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Creating RPC server for service cinder-volume {{(pid=86088) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.service [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86088) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 12:30:04 devstack cinder-volume[86088]: INFO cinder.volume.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86088) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86088) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:04 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:04 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:04 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:05 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:05 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.577s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:05 devstack cinder-volume[86088]: INFO cinder.volume.manager [None req-246c10ec-467a-4556-8b23-1c1b01954463 None None] Driver post RPC initialization completed successfully. Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86088) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG cinder.volume.drivers.quobyte [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86088) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86088) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:08 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:08 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:08 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG oslo_concurrency.processutils [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.262s {{(pid=86088) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:08 devstack cinder-volume[86088]: DEBUG cinder.manager [None req-b3fcdb64-2480-4002-9645-05e28efe26f5 None None] Notifying Schedulers of capabilities ... {{(pid=86088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:30:08 devstack cinder-volume[85871]: INFO oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Caught SIGTERM, stopping children Sep 29 12:30:08 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Acquiring lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:30:08 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Acquired lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:30:08 devstack cinder-volume[85871]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Releasing lock "singleton_lock" {{(pid=85871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:30:08 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Stop services. {{(pid=85871) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 12:30:08 devstack cinder-volume[85871]: DEBUG oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Killing children. {{(pid=85871) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 12:30:08 devstack cinder-volume[85871]: INFO oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Waiting on 1 children to exit Sep 29 12:30:13 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Acquiring lock "singleton_lock" {{(pid=86088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:30:13 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Acquired lock "singleton_lock" {{(pid=86088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:30:13 devstack cinder-volume[86088]: DEBUG oslo_concurrency.lockutils [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Releasing lock "singleton_lock" {{(pid=86088) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:30:13 devstack cinder-volume[86088]: WARNING amqp [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 12:30:13 devstack cinder-volume[86088]: WARNING amqp [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 12:30:13 devstack cinder-volume[85871]: INFO oslo_service.backend._eventlet.service [None req-1b26411f-67c2-4b23-814c-4b0f314f8dc2 None None] Child 86088 exited with status 0 Sep 29 12:30:13 devstack cinder-volume[86467]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 12:30:13 devstack cinder-volume[86467]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 12:30:13 devstack cinder-volume[86467]: we strongly recommend against using it for new projects. Sep 29 12:30:13 devstack cinder-volume[86467]: If you are already using Eventlet, we recommend migrating to a different Sep 29 12:30:13 devstack cinder-volume[86467]: framework. For more detail see Sep 29 12:30:13 devstack cinder-volume[86467]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 12:30:13 devstack cinder-volume[86467]: import eventlet # noqa Sep 29 12:30:16 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 12:30:16 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 12:30:16 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 12:30:17 devstack cinder-volume[86467]: INFO dbcounter [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Registered counter for database cinder Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_db.sqlalchemy.engines [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG dbcounter [-] [86467] Writer thread running {{(pid=86467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:30:17 devstack cinder-volume[86467]: INFO cinder.rpc [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 12:30:17 devstack cinder-volume[86467]: INFO cinder.rpc [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_db.sqlalchemy.engines [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:17 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Determined volume DB was empty at startup. Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG cinder.volume.manager [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86467) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 12:30:17 devstack cinder-volume[86467]: WARNING stevedore.named [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 12:30:17 devstack cinder-volume[86467]: WARNING castellan.key_manager [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:30:17 devstack cinder-volume[86467]: WARNING cinder.keymgr.conf_key_mgr [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 12:30:17 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_db.sqlalchemy.engines [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:17 devstack cinder-volume[86467]: INFO oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Starting 1 workers Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Started child 86763 {{(pid=86467) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Full set of CONF: {{(pid=86467) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] ******************************************************************************** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] Configuration options gathered from: {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] ================================================================================ {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] allow_availability_zone_fallback = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] allow_compression_on_image_upload = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] allowed_direct_url_schemes = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] api_rate_limit = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] auth_strategy = keystone {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86763]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_availability_zone = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_host = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_stats_polling_interval = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backup_api_class = cinder.backup.api.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backup_name_template = backup-%s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backup_use_same_host = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backup_use_temp_snapshot = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] chap_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] chap_username = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_internal_tenant_project_id = 28e169f7cf8d4815aba814d72c6d3a77 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_internal_tenant_user_id = bccb347a6a1f4488866bb7fbf4f3457d {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cluster = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] compression_format = gzip {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] compute_api_class = cinder.compute.nova.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] config_dir = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] config_source = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] control_exchange = openstack {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] debug = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] default_availability_zone = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] default_group_type = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] default_volume_type = QuobyteHD {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] disk_geometry = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_client_cert = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_client_cert_key = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_data_namespace = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_ssl_cert_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_ssl_cert_verify = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] driver_use_ssl = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] enable_new_services = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] enable_unsupported_driver = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] enabled_backends = ['QuobyteHD'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] enforce_multipath_for_image_xfer = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] filter_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_api_insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_api_ssl_compression = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_ca_certificates_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_catalog_info = image:glance:publicURL {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_num_retries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance_request_timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] goodness_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] graceful_shutdown_timeout = 5 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] group_api_class = cinder.group.api.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] host = devstack {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_compress_on_upload = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_conversion_address_space_limit = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_conversion_cpu_limit = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_conversion_disable = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_introspection_address_space_limit = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_introspection_cpu_limit = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_upload_use_cinder_backend = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_upload_use_internal_tenant = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_volume_cache_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_volume_cache_max_count = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] image_volume_cache_max_size_gb = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] init_host_max_objects_retrieval = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] instance_format = [instance: %(uuid)s] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iscsi_target_flags = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iscsi_write_cache = on {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iser_helper = tgtadm {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iser_ip_address = 192.168.122.201 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iser_port = 3260 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_color = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_config_append = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_dir = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_options = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_rotate_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_rotate_interval_type = days {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] log_rotation_type = none {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] max_age = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] max_logfile_count = 30 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] max_logfile_size_mb = 200 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] max_over_subscription_ratio = 20.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] message_reap_interval = 86400 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] message_ttl = 2592000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] migration_create_volume_timeout_secs = 300 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] monkey_patch = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] monkey_patch_modules = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] my_ip = 192.168.122.201 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] no_snapshot_gb_quota = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] num_iser_scan_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] num_shell_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] num_volume_device_scan_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] nvmeof_conn_info_version = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] nvmet_ns_id = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] nvmet_port_id = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_max_limit = 1000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_ext_list = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_listen_port = 8776 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_use_ssl = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] osapi_volume_workers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] per_volume_size_limit = -1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] periodic_fuzzy_delay = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] periodic_interval = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] public_endpoint = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] publish_errors = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_backup_gigabytes = 1000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_backups = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_gigabytes = 1000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_groups = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_snapshots = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] quota_volumes = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] rate_limit_burst = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] rate_limit_except_level = CRITICAL {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] rate_limit_interval = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] reinit_driver_count = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] replication_device = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] report_discard_supported = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] report_interval = 120 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] reservation_clean_interval = 86400 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] reservation_expire = 86400 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] reserved_image_namespaces = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] reserved_percentage = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] rpc_response_timeout = 120 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] run_external_periodic_tasks = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] scst_target_driver = iscsi {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] scst_target_iqn_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_down_time = 720 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] shell_completion = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] snapshot_name_template = snapshot-%s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] split_loggers = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] state_path = /opt/stack/data/cinder {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] storage_availability_zone = nova {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] storage_protocol = iSCSI {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] syslog_log_facility = LOG_USER {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_helper = lioadm {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_ip_address = 192.168.122.201 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_port = 3260 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_protocol = iscsi {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] target_secondary_ip_addresses = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86763) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] trace_flags = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] transport_url = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] until_refresh = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_chap_auth = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_default_quota_class = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_journal = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_json = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_multipath_for_image_xfer = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_stderr = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] use_syslog = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] verify_glance_signatures = enabled {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_api_class = cinder.volume.api.API {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_backend_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_clear = zero {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_clear_ionice = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_clear_size = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_copy_bps_limit = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_dd_blocksize = 1M {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_name_template = volume-%s {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_service_inithost_offload = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volume_usage_audit_period = month {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] zoning_mode = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_concurrency.disable_process_locking = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.auth_section = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.auth_type = password {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.auth_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.cache = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.include_service_catalog = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.interface = public {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcache_username = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.region_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.service_type = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.backend = dogpile.cache.null {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.backend_argument = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.backend_expiration_time = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.config_prefix = cache.oslo {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.debug_cache_backend = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.enable_retry_client = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.enable_socket_keepalive = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.expiration_time = 600 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.hashclient_retry_attempts = 2 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_dead_retry = 300 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_pool_maxsize = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_sasl_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.proxies = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.redis_db = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.redis_server = localhost:6379 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.retry_attempts = 2 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.retry_delay = 0.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.socket_keepalive_count = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.socket_keepalive_idle = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.socket_keepalive_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.socket_timeout = 1.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.tls_allowed_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.tls_cafile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.tls_certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.tls_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.tls_keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cache.username = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] coordination.backend_url = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.asyncio_connection = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.asyncio_slave_connection = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.backend = sqlalchemy {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.connection = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.connection_debug = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.connection_parameters = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.connection_recycle_time = 3600 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.connection_trace = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.db_inc_retry_interval = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.db_max_retries = 20 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.db_max_retry_interval = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.db_retry_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.max_overflow = 50 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.max_pool_size = 5 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.max_retries = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.mysql_wsrep_sync_wait = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.pool_timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.retry_interval = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.slave_connection = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.sqlite_synchronous = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.synchronous_reader = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] database.use_db_reconnect = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_tracing.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.connection_string = messaging:// {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.es_doc_type = notification {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.es_scroll_size = 10000 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.es_scroll_time = 2m {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.filter_error_trace = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.hmac_keys = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.sentinel_service_name = mymaster {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.socket_timeout = 0.1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.trace_requests = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler.trace_sqlalchemy = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler_jaeger.process_tags = {} {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler_jaeger.service_name_prefix = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] profiler_otlp.service_name_prefix = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86763) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.enforce_new_defaults = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.policy_default_rule = default {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.policy_file = policy.yaml {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:17 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Running cmd (subprocess): mount.quobyte {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.group = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.helper_command = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] privsep_osbrick.user = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.group = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.helper_command = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] cinder_sys_admin.user = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.auth_section = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.auth_type = password {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.cafile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.collect_timing = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.send_service_user_token = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.split_loggers = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.tls_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] service_user.tls_min_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.auth_section = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.auth_type = password {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.collect_timing = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.region_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.split_loggers = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.tls_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] glance.tls_min_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.backend_availability_zone = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.chap_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.chap_username = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.disk_geometry = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_client_cert = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_client_cert_key = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_data_namespace = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.driver_use_ssl = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.extra_capabilities = {} {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.filter_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.goodness_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iscsi_target_flags = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iscsi_write_cache = on {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iser_helper = tgtadm {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iser_port = 3260 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_host = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_login = admin {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_mount_options = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_private_key = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_share_path = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.num_shell_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.quobyte_volume_url = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.replication_device = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.report_discard_supported = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.reserved_percentage = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_helper = tgtadm {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_port = 3260 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_protocol = iscsi {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.trace_flags = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.unique_fqdn_network = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.use_chap_auth = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_backend_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_clear = zero {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_clear_ionice = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_clear_size = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_reports.file_event_handler = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_reports.log_dir = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.backend_availability_zone = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.backend_host = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.chap_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.chap_username = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.chiscsi_conf = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.disk_geometry = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_client_cert = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_data_namespace = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.driver_use_ssl = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.extra_capabilities = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.filter_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.goodness_function = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iser_helper = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iser_ip_address = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iser_port = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.iser_target_prefix = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_host = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_login = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_mount_options = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_password = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_private_key = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_share_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_ssh_port = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.num_shell_tries = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.nvmet_port_id = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.replication_device = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.report_discard_supported = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.reserved_percentage = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.scst_target_driver = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.storage_protocol = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_helper = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_ip_address = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_port = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_prefix = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_protocol = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.trace_flags = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.use_chap_auth = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_clear = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_clear_size = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack quobyte-client[86767]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] QuobyteHD.volumes_dir = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack quobyte-client[86767]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_notifications.driver = [] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_notifications.retry = -1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] key_manager.fixed_key = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.barbican_api_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.barbican_endpoint = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.barbican_endpoint_type = public {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.barbican_region_name = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.cafile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.collect_timing = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.number_of_retries = 60 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.retry_delay = 1 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.send_service_user_token = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.split_loggers = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.tls_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.tls_min_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.verify_ssl = True {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican.verify_ssl_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.auth_section = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.auth_type = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.cafile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.certfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.collect_timing = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.insecure = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.keyfile = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.split_loggers = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.timeout = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.tls_ciphers = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] barbican_service_user.tls_min_version = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.approle_role_id = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.approle_secret_id = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.auth_method = approle {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.auth_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.kv_mountpoint = secret {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.kv_path = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.kv_version = 2 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.namespace = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.root_token_id = **** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.ssl_ca_crt_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.timeout = 60.0 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.token_file = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.token_role = None {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.use_ssl = False {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 12:30:18 devstack cinder-volume[86467]: DEBUG oslo_service.backend._eventlet.service [None req-b183eb51-4c5c-4471-a056-ed2f4e41599a None None] ******************************************************************************** {{(pid=86467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 12:30:18 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:18 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:18 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.242s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.volume.driver [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Driver hasn't implemented _init_vendor_properties() Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.driver [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0428924560547, 'free_capacity_gb': 1775.0428924560547, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_db.sqlalchemy.engines [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writer thread running {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.db.api [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Building query based on filter {{(pid=86763) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86763) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.keymgr.migration [None req-54d3bc04-e647-4f05-8659-7c1c7c93e77b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 12:30:18 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:18 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:18 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.231s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Driver initialization completed successfully. Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Initiating service 3 cleanup Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Service 3 cleanup completed. Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.service [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Creating RPC server for service cinder-volume {{(pid=86763) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.service [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86763) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 12:30:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:30:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:30:18 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:30:18 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:30:19 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Sep 29 12:30:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:30:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-322a0861-6f86-46d5-b9c4-1c4afbdb6f3b None None] Driver post RPC initialization completed successfully. Sep 29 12:30:27 devstack cinder-volume[86467]: DEBUG dbcounter [-] [86467] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:30:28 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:30:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:30:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:30:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 6 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:30:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:30 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:31:30 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:30 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.704s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 6 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:31:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Flow 'volume_create_manager' (dde4c8a3-1a2a-4fc6-a4f1-f8b9d21cf260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf1b98f-a979-460c-8dcc-9194cdab6558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf1b98f-a979-460c-8dcc-9194cdab6558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1899859659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29489b5-1c1b-4823-ad10-293636267a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d1a37ca0c5445b8057a308b1424554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:31Z,use_quota=True,user_id='3bb33d3db5214e888af25d748008b30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0e797f-7c8f-40ab-bbee-21dc4feb565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0e797f-7c8f-40ab-bbee-21dc4feb565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadb84ba-fbd7-4627-bd6f-088540520c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadb84ba-fbd7-4627-bd6f-088540520c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29489b5-1c1b-4823-ad10-293636267a3e', 'volume_name': 'volume-c29489b5-1c1b-4823-ad10-293636267a3e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737ab38c-f610-4bd5-b058-e38ffcc3a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737ab38c-f610-4bd5-b058-e38ffcc3a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247d57d2-2d4c-4da8-9829-760197edec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Volume c29489b5-1c1b-4823-ad10-293636267a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29489b5-1c1b-4823-ad10-293636267a3e', 'volume_size': 1} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1899859659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29489b5-1c1b-4823-ad10-293636267a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d1a37ca0c5445b8057a308b1424554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:31Z,use_quota=True,user_id='3bb33d3db5214e888af25d748008b30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Creating volume c29489b5-1c1b-4823-ad10-293636267a3e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:31:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:31:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:31:32 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:31:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:32 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e 1073741824 Sep 29 12:31:32 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:33 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e 1073741824" returned: 0 in 1.834s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:34 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e Sep 29 12:31:34 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:34 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e" returned: 0 in 0.626s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] <== create_volume: return (2727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.729s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247d57d2-2d4c-4da8-9829-760197edec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29489b5-1c1b-4823-ad10-293636267a3e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50b7bba-ae8f-4ef1-ac1a-418c21c9fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Volume volume-c29489b5-1c1b-4823-ad10-293636267a3e (c29489b5-1c1b-4823-ad10-293636267a3e): created successfully Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50b7bba-ae8f-4ef1-ac1a-418c21c9fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Flow 'volume_create_manager' (dde4c8a3-1a2a-4fc6-a4f1-f8b9d21cf260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:31:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-baefb2de-01c6-4d61-ba75-b33ccc63244b tempest-DeleteServersTestJSON-728191151 None] Created volume successfully. Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Flow 'volume_create_manager' (9e7ecb63-f569-42b1-ad4e-405a998336f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744d8509-8ff8-4ce9-9519-0da50fc4e838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744d8509-8ff8-4ce9-9519-0da50fc4e838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1918102321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60645337-3ecf-4f15-8167-07d036cd071b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb5fa83d266481d9d78074a31f486b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:41Z,use_quota=True,user_id='98b0d41ac7a841a083cc467147bd277e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94919fd0-28ed-46d7-bb51-5230f55fa17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94919fd0-28ed-46d7-bb51-5230f55fa17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb97a18-50a6-4418-88ec-0d13f00315dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb97a18-50a6-4418-88ec-0d13f00315dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60645337-3ecf-4f15-8167-07d036cd071b', 'volume_name': 'volume-60645337-3ecf-4f15-8167-07d036cd071b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f7689-2511-4194-ad24-02b69aac5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f7689-2511-4194-ad24-02b69aac5d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85936668-f878-418b-9d4d-492e28adc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Volume 60645337-3ecf-4f15-8167-07d036cd071b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60645337-3ecf-4f15-8167-07d036cd071b', 'volume_size': 1} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1918102321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60645337-3ecf-4f15-8167-07d036cd071b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb5fa83d266481d9d78074a31f486b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:41Z,use_quota=True,user_id='98b0d41ac7a841a083cc467147bd277e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Creating volume 60645337-3ecf-4f15-8167-07d036cd071b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:31:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:41 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b 1073741824 Sep 29 12:31:41 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:41 devstack cinder-volume[86763]: WARNING py.warnings [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 29 12:31:41 devstack cinder-volume[86763]: .first() Sep 29 12:31:41 devstack cinder-volume[86763]: Sep 29 12:31:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:42 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b 1073741824" returned: 0 in 0.869s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:42 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b Sep 29 12:31:42 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:42 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b" returned: 0 in 0.380s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.120s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85936668-f878-418b-9d4d-492e28adc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60645337-3ecf-4f15-8167-07d036cd071b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584251f1-77bc-44f7-9458-a8eeafb24082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.194s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Volume volume-60645337-3ecf-4f15-8167-07d036cd071b (60645337-3ecf-4f15-8167-07d036cd071b): created successfully Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584251f1-77bc-44f7-9458-a8eeafb24082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Flow 'volume_create_manager' (9e7ecb63-f569-42b1-ad4e-405a998336f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:31:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-47d29e58-957d-4e6e-8db8-edb79b901364 tempest-ServerRescueNegativeTestJSON-716961503 None] Created volume successfully. Sep 29 12:31:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-c29489b5-1c1b-4823-ad10-293636267a3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8be6620-4b8c-4c55-a5e3-32b4f91b7942', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:31:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-1ea44eac-d199-4e6c-b46c-ba1614a65bc5 req-4504dafe-257f-46d5-b3d0-3a664f8618ba tempest-DeleteServersTestJSON-728191151 None] attachment_update completed successfully. Sep 29 12:31:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d8fde6d9-16a6-4b87-bcd0-11e4caeb4f1b req-47562632-26e5-4650-8ab7-dd914de4a8ff tempest-DeleteServersTestJSON-728191151 None] Terminate volume connection completed successfully. Sep 29 12:31:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d8fde6d9-16a6-4b87-bcd0-11e4caeb4f1b req-47562632-26e5-4650-8ab7-dd914de4a8ff tempest-DeleteServersTestJSON-728191151 None] Deleting attachment c8be6620-4b8c-4c55-a5e3-32b4f91b7942. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:31:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "cinder-c29489b5-1c1b-4823-ad10-293636267a3e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:31:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "cinder-c29489b5-1c1b-4823-ad10-293636267a3e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:31:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "cinder-quobyte-c29489b5-1c1b-4823-ad10-293636267a3e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:31:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "cinder-quobyte-c29489b5-1c1b-4823-ad10-293636267a3e" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:31:54 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8acjj377/privsep.sock'] Sep 29 12:31:54 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8acjj377/privsep.sock Sep 29 12:31:54 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 12:31:56 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 29 12:31:56 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:56 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Spawned new privsep daemon via rootwrap Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Accepted privsep connection to /tmp/tmp8acjj377/privsep.sock {{(pid=86763) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 29 12:31:56 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 29 12:31:56 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 29 12:31:56 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 29 12:31:56 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88838 Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d01799f-fc6f-4437-bee7-b8263b1eccb8]: (2,) {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c6ad4-5a9f-4d0f-893b-91c5c8b1c04c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:56 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e Sep 29 12:31:56 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:56 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e" returned: 0 in 0.472s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:56 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e Sep 29 12:31:56 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:57 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c29489b5-1c1b-4823-ad10-293636267a3e" returned: 0 in 0.274s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "cinder-quobyte-c29489b5-1c1b-4823-ad10-293636267a3e" released by "delete_volume" :: held 3.210s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:31:57 devstack cinder-volume[86763]: WARNING cinder.quota [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:31:57 devstack cinder-volume[86763]: WARNING cinder.quota [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Created reservations ['49ba4822-2716-49c5-a474-a5ba887df3fa', '1476e0d4-f3ee-47e1-b053-9b218a7db3fa', '81efe4e6-1293-48c8-9986-53e4f85b2596', '554448d7-11da-4d05-8ce0-28d14b6ba7c0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:31:57 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:31:57 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:31:57 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.516s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:31:57 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:31:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Deleted volume successfully. Sep 29 12:31:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a36c911a-3e45-431f-93f5-a7b8e4fc75fe tempest-DeleteServersTestJSON-728191151 None] Lock "cinder-c29489b5-1c1b-4823-ad10-293636267a3e-delete_volume" released by "delete_volume" :: held 4.105s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Acquiring lock "cinder-60645337-3ecf-4f15-8167-07d036cd071b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "cinder-60645337-3ecf-4f15-8167-07d036cd071b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Acquiring lock "cinder-quobyte-60645337-3ecf-4f15-8167-07d036cd071b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "cinder-quobyte-60645337-3ecf-4f15-8167-07d036cd071b" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbdca4-f837-4c8a-b930-633b07d21339]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:31:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:00 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b Sep 29 12:32:00 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:00 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:00 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b Sep 29 12:32:00 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:00 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-60645337-3ecf-4f15-8167-07d036cd071b" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "cinder-quobyte-60645337-3ecf-4f15-8167-07d036cd071b" released by "delete_volume" :: held 0.908s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Created reservations ['367ffa70-fea5-440e-80a5-23512f488419', '1fe0c9fa-dda7-4f59-bce4-260cec57aa3b', 'd474fbbf-357c-4177-a637-d7d161c4d106', '21d19c4a-9ace-4636-a265-8ad6b8778eac'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:00 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:32:00 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:01 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:32:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Deleted volume successfully. Sep 29 12:32:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b700f442-387c-48e4-a7a6-a2e1e2c86259 tempest-ServerRescueNegativeTestJSON-716961503 None] Lock "cinder-60645337-3ecf-4f15-8167-07d036cd071b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Flow 'volume_create_manager' (891539f5-d787-45ad-bb95-363dec882c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b812c80-2597-4e78-93c5-b9130c88f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b812c80-2597-4e78-93c5-b9130c88f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-15683069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37a156a-eb04-4324-8694-e62fb707524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd00693b5f7d4fd9b5c6b1cfc17fc713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:03Z,use_quota=True,user_id='93361b4797134e7fba4a05f25ce694fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61f4122-6d57-4c92-beb7-18201d8e074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61f4122-6d57-4c92-beb7-18201d8e074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1010774e-e860-4bb6-9935-8435d5a2bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1010774e-e860-4bb6-9935-8435d5a2bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37a156a-eb04-4324-8694-e62fb707524f', 'volume_name': 'volume-f37a156a-eb04-4324-8694-e62fb707524f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbe2875-59d0-41eb-8077-b9b8a09c1321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbe2875-59d0-41eb-8077-b9b8a09c1321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b9329-f42d-485d-a4ba-ac32f3d158b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Volume f37a156a-eb04-4324-8694-e62fb707524f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37a156a-eb04-4324-8694-e62fb707524f', 'volume_size': 1} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-15683069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37a156a-eb04-4324-8694-e62fb707524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd00693b5f7d4fd9b5c6b1cfc17fc713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:03Z,use_quota=True,user_id='93361b4797134e7fba4a05f25ce694fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Creating volume f37a156a-eb04-4324-8694-e62fb707524f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:32:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:32:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:03 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f 1073741824 Sep 29 12:32:03 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:04 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f 1073741824" returned: 0 in 0.585s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:04 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f Sep 29 12:32:04 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:04 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f" returned: 0 in 0.431s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b9329-f42d-485d-a4ba-ac32f3d158b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37a156a-eb04-4324-8694-e62fb707524f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8e95ba-d42b-444d-9a3b-bb7ec9019eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Volume volume-f37a156a-eb04-4324-8694-e62fb707524f (f37a156a-eb04-4324-8694-e62fb707524f): created successfully Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8e95ba-d42b-444d-9a3b-bb7ec9019eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Flow 'volume_create_manager' (891539f5-d787-45ad-bb95-363dec882c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:32:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d99e8b28-6682-45e6-818c-342db7998a5d tempest-AttachVolumeShelveTestJSON-1024944470 None] Created volume successfully. Sep 29 12:32:14 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=17,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:32:14 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=19,cinder:UPDATE=36,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:32:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:32:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:30 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:32:30 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:30 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.276s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 8 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:32:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:32:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-299bb7b3-77f1-4a45-aaae-7bdeb8ed2a54 req-a0d7be43-6ea7-497f-9748-9e6434204cc8 tempest-AttachVolumeShelveTestJSON-1024944470 None] No connector for attachment ee9ce9f2-3b12-4f9f-8eca-8bfb3f80962a; skipping storage backend terminate_connection call. {{(pid=86763) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 29 12:32:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-299bb7b3-77f1-4a45-aaae-7bdeb8ed2a54 req-a0d7be43-6ea7-497f-9748-9e6434204cc8 tempest-AttachVolumeShelveTestJSON-1024944470 None] Deleting attachment ee9ce9f2-3b12-4f9f-8eca-8bfb3f80962a. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Flow 'volume_create_manager' (2a80994b-3d9c-43d4-b102-8001672b1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f62d513-b96e-42ee-b06f-adf59812f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f62d513-b96e-42ee-b06f-adf59812f004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-999814620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21a707a8db74901af5c9de31cf5ec55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:52Z,use_quota=True,user_id='99e6e6479d0343dca543c8e28d01a394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6920a4-9364-4c46-925d-c0a551ce723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6920a4-9364-4c46-925d-c0a551ce723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b936adad-88f2-49dd-bfc6-e32a04623149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b936adad-88f2-49dd-bfc6-e32a04623149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54', 'volume_name': 'volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb564ff3-c5f9-46a7-9f86-88494880b425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb564ff3-c5f9-46a7-9f86-88494880b425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dfd27f-faff-43f3-a8af-b26b74b83ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Volume 8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54', 'volume_size': 1} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-999814620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21a707a8db74901af5c9de31cf5ec55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:52Z,use_quota=True,user_id='99e6e6479d0343dca543c8e28d01a394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Creating volume 8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:32:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:32:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:51 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 1073741824 Sep 29 12:32:51 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:52 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 1073741824" returned: 0 in 0.705s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:32:52 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 Sep 29 12:32:52 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:32:52 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dfd27f-faff-43f3-a8af-b26b74b83ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c66b2b3-69eb-4403-96af-cf83dee3973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:32:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Volume volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 (8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54): created successfully Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c66b2b3-69eb-4403-96af-cf83dee3973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:32:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Flow 'volume_create_manager' (2a80994b-3d9c-43d4-b102-8001672b1274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:32:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ab3343cc-d840-4416-949d-dcdeb56c1394 tempest-TaggedAttachmentsTest-46494872 None] Created volume successfully. Sep 29 12:33:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:33:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Flow 'volume_create_manager' (be0c1c3d-f6a6-44dc-bcb5-bcb05e396569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afeb08d-5961-430d-b5bc-0ea78430f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afeb08d-5961-430d-b5bc-0ea78430f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1361358282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c121586d-7f27-48ad-97e3-822d20087155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7822d125ce2943a2add63b5cb9bf9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:17Z,use_quota=True,user_id='8e61ad47b29444ab8971e2abfc02b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c0d9b0-bed5-470d-b7d6-2ae2654e2f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c0d9b0-bed5-470d-b7d6-2ae2654e2f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ede1aaa-35a6-411f-a9ce-44108620763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ede1aaa-35a6-411f-a9ce-44108620763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c121586d-7f27-48ad-97e3-822d20087155', 'volume_name': 'volume-c121586d-7f27-48ad-97e3-822d20087155', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b3f67f-9b28-44e2-b258-bbe53a808d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b3f67f-9b28-44e2-b258-bbe53a808d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fdf1f0-4ddc-495f-9224-659a4582e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Volume c121586d-7f27-48ad-97e3-822d20087155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c121586d-7f27-48ad-97e3-822d20087155', 'volume_size': 1} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1361358282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c121586d-7f27-48ad-97e3-822d20087155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7822d125ce2943a2add63b5cb9bf9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:17Z,use_quota=True,user_id='8e61ad47b29444ab8971e2abfc02b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Creating volume c121586d-7f27-48ad-97e3-822d20087155 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:33:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:33:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:17 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 1073741824 Sep 29 12:33:17 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:18 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 1073741824" returned: 0 in 0.935s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:18 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 Sep 29 12:33:18 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:18 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155" returned: 0 in 0.318s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fdf1f0-4ddc-495f-9224-659a4582e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c121586d-7f27-48ad-97e3-822d20087155', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44482cf3-1e57-4b12-926b-368e03a32c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Volume volume-c121586d-7f27-48ad-97e3-822d20087155 (c121586d-7f27-48ad-97e3-822d20087155): created successfully Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44482cf3-1e57-4b12-926b-368e03a32c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Flow 'volume_create_manager' (be0c1c3d-f6a6-44dc-bcb5-bcb05e396569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:33:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-18437097-d964-4792-877b-f19b49c2d807 tempest-VolumesAdminNegativeTest-1309007464 None] Created volume successfully. Sep 29 12:33:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Acquiring lock "cinder-c121586d-7f27-48ad-97e3-822d20087155-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:33:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "cinder-c121586d-7f27-48ad-97e3-822d20087155-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Acquiring lock "cinder-quobyte-c121586d-7f27-48ad-97e3-822d20087155" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "cinder-quobyte-c121586d-7f27-48ad-97e3-822d20087155" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[490176f4-1c92-48f7-8a73-af8aec5bccd3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:20 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 Sep 29 12:33:20 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:20 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155" returned: 0 in 0.675s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:20 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155 Sep 29 12:33:20 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:21 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c121586d-7f27-48ad-97e3-822d20087155" returned: 0 in 0.478s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "cinder-quobyte-c121586d-7f27-48ad-97e3-822d20087155" released by "delete_volume" :: held 1.257s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Created reservations ['9a3bd8c1-e978-46d0-adc4-551ca6841567', '382a3db0-263b-499b-ad54-c2be014e00ba', 'ba216709-99f7-4c25-8e10-b75d739cd3fb', '31a8a0f7-60ea-4730-99df-087427233e50'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:21 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:33:21 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:21 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:33:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Deleted volume successfully. Sep 29 12:33:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ad13faf-0d03-4369-9935-49acdca86956 tempest-VolumesAdminNegativeTest-1309007464 None] Lock "cinder-c121586d-7f27-48ad-97e3-822d20087155-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:30 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:33:30 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:30 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.416s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 8 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:33:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:33:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:33:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (dfa86c02-31fa-4fe7-af48-c71e39fb7f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661b2679-fd89-4946-add3-ab9fb656fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661b2679-fd89-4946-add3-ab9fb656fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1434296027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb4a3d8-f50b-4a1e-b7e0-16f554538d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:56Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8967ba48-e568-4a12-82e0-eab59913d2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8967ba48-e568-4a12-82e0-eab59913d2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac74e46-3e88-461a-800a-c68323bc0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac74e46-3e88-461a-800a-c68323bc0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb4a3d8-f50b-4a1e-b7e0-16f554538d66', 'volume_name': 'volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d2bd58-cb1d-4ec0-ab5d-9b47b96a6591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d2bd58-cb1d-4ec0-ab5d-9b47b96a6591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdedf3e3-650e-41cf-8de6-2513cc74cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Volume 4bb4a3d8-f50b-4a1e-b7e0-16f554538d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66', 'volume_size': 1} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1434296027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb4a3d8-f50b-4a1e-b7e0-16f554538d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:56Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Creating volume 4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:33:55 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:33:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:55 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 1073741824 Sep 29 12:33:55 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Acquiring lock "cinder-f37a156a-eb04-4324-8694-e62fb707524f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "cinder-f37a156a-eb04-4324-8694-e62fb707524f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Acquiring lock "cinder-quobyte-f37a156a-eb04-4324-8694-e62fb707524f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "cinder-quobyte-f37a156a-eb04-4324-8694-e62fb707524f" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189af66-c943-4ede-b5a4-658b1de36478]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:56 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 1073741824" returned: 0 in 0.614s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:56 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f Sep 29 12:33:56 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:56 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 Sep 29 12:33:56 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:56 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f" returned: 0 in 0.472s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:56 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" returned: 0 in 0.344s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:56 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f Sep 29 12:33:56 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdedf3e3-650e-41cf-8de6-2513cc74cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6d4e84-d6bf-4fd9-a6a5-8eb16c1fcd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:33:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Volume volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 (4bb4a3d8-f50b-4a1e-b7e0-16f554538d66): created successfully Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6d4e84-d6bf-4fd9-a6a5-8eb16c1fcd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (dfa86c02-31fa-4fe7-af48-c71e39fb7f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:33:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aa73781f-d07e-4186-9334-ba5e63ae56fb tempest-AttachVolumeTestJSON-960941537 None] Created volume successfully. Sep 29 12:33:56 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f37a156a-eb04-4324-8694-e62fb707524f" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "cinder-quobyte-f37a156a-eb04-4324-8694-e62fb707524f" released by "delete_volume" :: held 0.817s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Created reservations ['7343aa1e-d992-4021-aab6-f26582aaa96c', '890f2945-f8ec-47ec-9d3f-b73be6bfcc4d', '9563910f-9f30-4dab-9a8c-e70c87b32a0f', '95d3a5fb-6513-4442-ae9e-13e6d5d7ebb6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:33:57 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:33:57 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:33:57 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:33:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Deleted volume successfully. Sep 29 12:33:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c35418b-d6b7-4c1e-8694-ae347852aa39 tempest-AttachVolumeShelveTestJSON-1024944470 None] Lock "cinder-f37a156a-eb04-4324-8694-e62fb707524f-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:33:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bfb974b6-fece-4716-8c1b-fbf7a6d0f110 req-20af1a97-5b4e-40e0-a151-35aaf6a2101b tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:33:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bfb974b6-fece-4716-8c1b-fbf7a6d0f110 req-20af1a97-5b4e-40e0-a151-35aaf6a2101b tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:33:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bfb974b6-fece-4716-8c1b-fbf7a6d0f110 req-20af1a97-5b4e-40e0-a151-35aaf6a2101b tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:33:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-bfb974b6-fece-4716-8c1b-fbf7a6d0f110 req-20af1a97-5b4e-40e0-a151-35aaf6a2101b tempest-AttachVolumeTestJSON-960941537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b01d8f62-4f59-47e0-808a-a176debde7ed', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:33:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-bfb974b6-fece-4716-8c1b-fbf7a6d0f110 req-20af1a97-5b4e-40e0-a151-35aaf6a2101b tempest-AttachVolumeTestJSON-960941537 None] attachment_update completed successfully. Sep 29 12:34:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-39f624b7-b4b3-46c4-848c-75f5b4319c69 req-444cdc0a-fb5e-4599-9efe-239389e90a9b tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-39f624b7-b4b3-46c4-848c-75f5b4319c69 req-444cdc0a-fb5e-4599-9efe-239389e90a9b tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-39f624b7-b4b3-46c4-848c-75f5b4319c69 req-444cdc0a-fb5e-4599-9efe-239389e90a9b tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-39f624b7-b4b3-46c4-848c-75f5b4319c69 req-444cdc0a-fb5e-4599-9efe-239389e90a9b tempest-TaggedAttachmentsTest-46494872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4eb5c78-b452-4549-9614-847186d35bfd', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:34:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-39f624b7-b4b3-46c4-848c-75f5b4319c69 req-444cdc0a-fb5e-4599-9efe-239389e90a9b tempest-TaggedAttachmentsTest-46494872 None] attachment_update completed successfully. Sep 29 12:34:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-69201ba4-a8d4-42b8-8feb-b72deebca824 req-31c9fab3-eaad-4043-a980-21d155b7c05f tempest-TaggedAttachmentsTest-46494872 None] Terminate volume connection completed successfully. Sep 29 12:34:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-69201ba4-a8d4-42b8-8feb-b72deebca824 req-31c9fab3-eaad-4043-a980-21d155b7c05f tempest-TaggedAttachmentsTest-46494872 None] Deleting attachment a4eb5c78-b452-4549-9614-847186d35bfd. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:34:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75b50ad9-2d29-44c4-a5d4-c1f449e11f18 tempest-BackendsCapabilitiesAdminTestsJSON-801592109 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0428924560547, 'free_capacity_gb': 1775.0428924560547, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 12:34:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-928f7db2-f1d5-4391-bab0-31ecd6754c12 tempest-BackendsCapabilitiesAdminTestsJSON-801592109 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0428924560547, 'free_capacity_gb': 1775.0428924560547, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 12:34:17 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=14,cinder:SELECT=18,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:34:17 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=24,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:34:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "cinder-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "cinder-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "cinder-quobyte-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "cinder-quobyte-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cd9278-1ebc-4f10-9f9b-e4d68b737686]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:22 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 Sep 29 12:34:22 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:22 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" returned: 0 in 0.470s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:22 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54 Sep 29 12:34:22 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:22 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "cinder-quobyte-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54" released by "delete_volume" :: held 0.848s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Created reservations ['9bed5526-75d5-4775-b239-0e1350ea4a8f', '9b88e25e-670f-4cda-9881-a628b17311fd', '6d877350-b1bc-42c5-9ed5-30b035efed7a', 'dbc5b575-0e24-4cc8-8de9-f2038619f653'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:23 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:34:23 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3e29735-ad17-4f1f-a742-96f31994e38c tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-1377154570: creating Sep 29 12:34:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3e29735-ad17-4f1f-a742-96f31994e38c tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-1377154570: created successfully Sep 29 12:34:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3e29735-ad17-4f1f-a742-96f31994e38c tempest-GroupSnapshotsTest-1248204784 None] Create group completed successfully. Sep 29 12:34:23 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.403s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:34:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Deleted volume successfully. Sep 29 12:34:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0545f1c-79d8-415c-bf7e-f8d58a565bdd tempest-TaggedAttachmentsTest-46494872 None] Lock "cinder-8a7cdf52-de6f-4e25-a1cd-5325ee0cfb54-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (577363dd-68db-43b4-8800-3e5d8f1e3744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c243433d-78cb-4289-b7b3-e3ac9aeb9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c243433d-78cb-4289-b7b3-e3ac9aeb9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931326383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8535ec3f-871e-4ce7-b2aa-0da1271e711c,host='devstack@QuobyteHD#QuobyteHD',id=bb372884-f63d-4ed3-a688-cd57e5526ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:25Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d2a3735-91a7-4a37-a96c-2fb3cbfc0b16),volume_type_id=8d2a3735-91a7-4a37-a96c-2fb3cbfc0b16)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d50983-f0e6-4c11-b78a-8cb592ba24f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d50983-f0e6-4c11-b78a-8cb592ba24f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55199c4a-d84e-43d7-ba9d-4832df99473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55199c4a-d84e-43d7-ba9d-4832df99473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb372884-f63d-4ed3-a688-cd57e5526ef8', 'volume_name': 'volume-bb372884-f63d-4ed3-a688-cd57e5526ef8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a7830-92e7-42ec-9193-1fd17ed29fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a7830-92e7-42ec-9193-1fd17ed29fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9022946-96c1-47de-9c0b-d6804f1709e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Volume bb372884-f63d-4ed3-a688-cd57e5526ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb372884-f63d-4ed3-a688-cd57e5526ef8', 'volume_size': 1} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8535ec3f-871e-4ce7-b2aa-0da1271e711c,created_at=2026-09-29T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931326383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8535ec3f-871e-4ce7-b2aa-0da1271e711c,host='devstack@QuobyteHD#QuobyteHD',id=bb372884-f63d-4ed3-a688-cd57e5526ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:25Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d2a3735-91a7-4a37-a96c-2fb3cbfc0b16),volume_type_id=8d2a3735-91a7-4a37-a96c-2fb3cbfc0b16)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Creating volume bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:34:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:25 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 1073741824 Sep 29 12:34:25 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:25 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 1073741824" returned: 0 in 0.639s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:26 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:26 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:26 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9022946-96c1-47de-9c0b-d6804f1709e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb372884-f63d-4ed3-a688-cd57e5526ef8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eda4f0-0223-4041-a226-75b19431e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Volume volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 (bb372884-f63d-4ed3-a688-cd57e5526ef8): created successfully Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eda4f0-0223-4041-a226-75b19431e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (577363dd-68db-43b4-8800-3e5d8f1e3744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d9143b6e-3448-4e12-a25d-7a9d1f723810 tempest-GroupSnapshotsTest-1248204784 None] Created volume successfully. Sep 29 12:34:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] GroupSnapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: creating. Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Group snapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Creating offline snapshot 88e9b959-710b-4a87-a4a1-63240ed2a2bb of volume bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9966580-b98c-4716-b2a6-468efbaddf03]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:27 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:27 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:27 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 0.480s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:27 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb 1G Sep 29 12:34:27 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:28 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb 1G" returned: 0 in 0.466s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:28 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:28 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:28 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:28 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:28 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:28 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:28 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:28 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info Sep 29 12:34:28 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:29 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:34:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:29 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info Sep 29 12:34:29 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:29 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.info" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d00174b7-033b-47d7-9449-af24767c6529 tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: created successfully Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:30 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:34:30 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:30 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Creating volume fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 from snapshot 88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] snapshot: 88e9b959-710b-4a87-a4a1-63240ed2a2bb, volume: fc76a8ff-5d51-4750-a7df-c0b6e8f405b8, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1184d3-7334-4b73-bc55-4727bb11f9f6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:31 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:31 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:31 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.381s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb372884-f63d-4ed3-a688-cd57e5526ef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1720f0-8856-4374-8799-a33534a535dc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:31 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:31 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:31 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 0.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:34:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:32 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 Sep 29 12:34:32 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-ec11ef51-6440-45cd-ae07-30a8cf6176dd req-80ea4d03-7291-4ed6-b2e6-9cfd15fee518 tempest-AttachVolumeTestJSON-960941537 None] Terminate volume connection completed successfully. Sep 29 12:34:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-ec11ef51-6440-45cd-ae07-30a8cf6176dd req-80ea4d03-7291-4ed6-b2e6-9cfd15fee518 tempest-AttachVolumeTestJSON-960941537 None] Deleting attachment b01d8f62-4f59-47e0-808a-a176debde7ed. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:34:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (4bf12206-ab53-4183-85e5-d3f928955e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a83d4d-6fe0-4bcc-bd8f-07c0c7bcbe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a83d4d-6fe0-4bcc-bd8f-07c0c7bcbe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1746845064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac7151-a4ee-446a-bac5-d87577dd8d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:40Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd71a4-0aa3-4cdb-b950-4aecb799f966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd71a4-0aa3-4cdb-b950-4aecb799f966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e7da96-aeb1-429a-9f1b-3107a9a87240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e7da96-aeb1-429a-9f1b-3107a9a87240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaac7151-a4ee-446a-bac5-d87577dd8d19', 'volume_name': 'volume-eaac7151-a4ee-446a-bac5-d87577dd8d19', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b6443d-a78d-4ed9-9a85-c4b057b83ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b6443d-a78d-4ed9-9a85-c4b057b83ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4626ac4d-f702-49b9-9eee-ecbdf82d4a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Volume eaac7151-a4ee-446a-bac5-d87577dd8d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaac7151-a4ee-446a-bac5-d87577dd8d19', 'volume_size': 1} Sep 29 12:34:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:41 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" returned: 0 in 9.329s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:34:41 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Converted 1024.00 MB image at 109.75 MB/s Sep 29 12:34:41 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:41 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 Sep 29 12:34:41 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:41 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" returned: 0 in 0.321s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" released by "_copy_volume_from_snapshot" :: held 10.522s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" released by "_create_volume_from_snapshot" :: held 10.593s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.609s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1746845064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac7151-a4ee-446a-bac5-d87577dd8d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:40Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Creating volume eaac7151-a4ee-446a-bac5-d87577dd8d19 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:34:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:34:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:41 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 1073741824 Sep 29 12:34:41 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-792f8e5d-ef69-44e3-8c92-4cce1c0e9fd4 tempest-GroupSnapshotsTest-1248204784 None] Create group from source-snapshot-36c1823c-b688-47fe-b4bf-949b8ba50e5b completed successfully. Sep 29 12:34:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 1073741824" returned: 0 in 0.756s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:42 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:42 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 Sep 29 12:34:42 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:43 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19" returned: 0 in 0.554s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cdc14d-09ee-4d97-9472-2b4a1675fdf0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4626ac4d-f702-49b9-9eee-ecbdf82d4a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaac7151-a4ee-446a-bac5-d87577dd8d19', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a24f0b2-dec3-4540-a14f-fdec16c4bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Volume volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 (eaac7151-a4ee-446a-bac5-d87577dd8d19): created successfully Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a24f0b2-dec3-4540-a14f-fdec16c4bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (4bf12206-ab53-4183-85e5-d3f928955e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ae7fe0b-6705-4a41-8b41-ef5db8976920 tempest-AttachVolumeNegativeTest-1839513264 None] Created volume successfully. Sep 29 12:34:43 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 Sep 29 12:34:43 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:43 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" returned: 0 in 0.561s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:43 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8 Sep 29 12:34:43 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:43 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-fc76a8ff-5d51-4750-a7df-c0b6e8f405b8" released by "delete_volume" :: held 0.902s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['9c6aa416-b3ef-4dff-bfce-b28116e29356'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:44 devstack cinder-volume[86763]: WARNING cinder.quota [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1030502955 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1030502955, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:34:44 devstack cinder-volume[86763]: WARNING cinder.quota [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1030502955 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1030502955, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['130ac9ca-3d88-4ddf-8a77-0ae8d956f63f', '90b480cb-e0aa-4748-b900-ded67fd0a4e8', '87f71eb1-ddec-4920-bdd5-47edef31cb20', '6eeb872a-35a6-47d4-ba4a-07419ca110a9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:44 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:34:44 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:44 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: deleting Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.465s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:34:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1319fa2e-a9fb-40a4-91d0-ed4d12314285 tempest-GroupSnapshotsTest-1248204784 None] Delete group completed successfully. Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Deleting offline snapshot 88e9b959-710b-4a87-a4a1-63240ed2a2bb of volume bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] snapshot_file for this snap is: volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[887f7708-0ed2-4380-a239-f7792480dde5]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:45 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:45 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9f605a7d-97ba-40b3-a8b4-9bf3ab032bf1 req-b238e699-9129-46a6-b351-11b3c7a1b262 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9f605a7d-97ba-40b3-a8b4-9bf3ab032bf1 req-b238e699-9129-46a6-b351-11b3c7a1b262 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9f605a7d-97ba-40b3-a8b4-9bf3ab032bf1 req-b238e699-9129-46a6-b351-11b3c7a1b262 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:45 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.610s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb372884-f63d-4ed3-a688-cd57e5526ef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b418ab-db5a-40ab-b34b-4d71cad25c98]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9f605a7d-97ba-40b3-a8b4-9bf3ab032bf1 req-b238e699-9129-46a6-b351-11b3c7a1b262 tempest-AttachVolumeNegativeTest-1839513264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-eaac7151-a4ee-446a-bac5-d87577dd8d19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0227d604-5935-4bb6-b522-4f3c28ee3516', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:34:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9f605a7d-97ba-40b3-a8b4-9bf3ab032bf1 req-b238e699-9129-46a6-b351-11b3c7a1b262 tempest-AttachVolumeNegativeTest-1839513264 None] attachment_update completed successfully. Sep 29 12:34:45 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:45 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:46 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 1.049s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:46 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:46 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:47 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.613s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:47 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb Sep 29 12:34:47 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:47 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8.88e9b959-710b-4a87-a4a1-63240ed2a2bb" returned: 0 in 0.572s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-88e9b959-710b-4a87-a4a1-63240ed2a2bb" released by "_delete_snapshot" :: held 3.044s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" released by "delete_snapshot" :: held 3.072s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:47 devstack cinder-volume[86763]: WARNING cinder.quota [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1030502955 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1030502955, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:34:48 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['c388122a-63f7-4565-b69a-0c7d971e92c9', '1efcdd48-2196-455c-87b7-3b58a0796452', '8bb36c18-ad7d-4395-9f26-d2b498388a04', 'a630a67a-9fab-4748-8329-21893656b191'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-841a9ae8-74f4-4f32-9986-26e4cecbf37f tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 36c1823c-b688-47fe-b4bf-949b8ba50e5b: deleted successfully Sep 29 12:34:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:34:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:34:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4d4ae-e5f2-4a7d-a81a-010442fc91cc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:34:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:49 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:49 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:49 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 0.633s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:49 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8 Sep 29 12:34:49 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:49 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb372884-f63d-4ed3-a688-cd57e5526ef8" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-bb372884-f63d-4ed3-a688-cd57e5526ef8" released by "delete_volume" :: held 1.073s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['d42c9f57-defa-4888-979a-6202f99373ab'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:50 devstack cinder-volume[86763]: WARNING cinder.db.api [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1030502955'] Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['ccadae02-84f6-47be-9ad6-964735e57322', '38ee5c5b-5b0b-46d3-809e-b4712d9d374b', 'e19524d0-3b14-48af-a2ab-6032c266e98c', '69141d90-80ad-41b2-8211-bd6c2f8e03fc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:50 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:34:50 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:50 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:34:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a50180d0-455e-4c88-888b-30a3dac6727f tempest-GroupSnapshotsTest-1248204784 None] Delete group completed successfully. Sep 29 12:34:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6b87edbe-9cdf-4340-8933-d40fabbe2b0d tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-842233704: creating Sep 29 12:34:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6b87edbe-9cdf-4340-8933-d40fabbe2b0d tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-842233704: created successfully Sep 29 12:34:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6b87edbe-9cdf-4340-8933-d40fabbe2b0d tempest-GroupSnapshotsTest-1248204784 None] Create group completed successfully. Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (b83ef72f-da8b-4262-901e-eab4cc97a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cb859d-a040-4476-9656-4c41d3b5b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cb859d-a040-4476-9656-4c41d3b5b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-350608076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,host='devstack@QuobyteHD#QuobyteHD',id=b00bf37c-e0f7-456f-9e18-02b52f2141dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:54Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0271b7d4-a3f6-411d-bda9-16ec65c911ba),volume_type_id=0271b7d4-a3f6-411d-bda9-16ec65c911ba)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5dd589-e070-40f7-8d27-871ede832083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5dd589-e070-40f7-8d27-871ede832083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb797b7-b88e-42c2-8ad2-278cc5e76ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb797b7-b88e-42c2-8ad2-278cc5e76ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00bf37c-e0f7-456f-9e18-02b52f2141dd', 'volume_name': 'volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c661f70f-1878-4dc9-b818-1e447e9acd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c661f70f-1878-4dc9-b818-1e447e9acd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23e834e-36cb-4e6b-a442-4bdc4c719d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Volume b00bf37c-e0f7-456f-9e18-02b52f2141dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd', 'volume_size': 1} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,created_at=2026-09-29T10:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-350608076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,host='devstack@QuobyteHD#QuobyteHD',id=b00bf37c-e0f7-456f-9e18-02b52f2141dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:54Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0271b7d4-a3f6-411d-bda9-16ec65c911ba),volume_type_id=0271b7d4-a3f6-411d-bda9-16ec65c911ba)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Creating volume b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:34:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:34:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:54 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd 1073741824 Sep 29 12:34:54 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:55 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd 1073741824" returned: 0 in 0.861s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:55 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd Sep 29 12:34:55 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:55 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd" returned: 0 in 0.340s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23e834e-36cb-4e6b-a442-4bdc4c719d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3afc1e-4fd4-41ce-b812-dab0ee040aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Volume volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd (b00bf37c-e0f7-456f-9e18-02b52f2141dd): created successfully Sep 29 12:34:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3afc1e-4fd4-41ce-b812-dab0ee040aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (b83ef72f-da8b-4262-901e-eab4cc97a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07ada6a0-e0c3-4716-a16f-a624eecc4a3e tempest-GroupSnapshotsTest-1248204784 None] Created volume successfully. Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (933639d8-abf8-4628-b03f-f3ff8a73c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebcf3f3-4c65-40cb-9a38-814fd563f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebcf3f3-4c65-40cb-9a38-814fd563f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653353774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,host='devstack@QuobyteHD#QuobyteHD',id=a9fd7756-d02f-4917-aa9b-cbec005d5d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:58Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0271b7d4-a3f6-411d-bda9-16ec65c911ba),volume_type_id=0271b7d4-a3f6-411d-bda9-16ec65c911ba)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18360458-1f95-42c7-b13d-68f17e20d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18360458-1f95-42c7-b13d-68f17e20d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0ec566-8bfb-4ee1-954e-85c30bdcd52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0ec566-8bfb-4ee1-954e-85c30bdcd52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fd7756-d02f-4917-aa9b-cbec005d5d79', 'volume_name': 'volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27129f39-2527-4fb2-847b-d74d07389473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27129f39-2527-4fb2-847b-d74d07389473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f7ae90-b634-4ca7-b6f8-65cd83149c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Volume a9fd7756-d02f-4917-aa9b-cbec005d5d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79', 'volume_size': 1} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,created_at=2026-09-29T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653353774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f650e221-0ae1-4799-87e5-26e74e4e0ca5,host='devstack@QuobyteHD#QuobyteHD',id=a9fd7756-d02f-4917-aa9b-cbec005d5d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:58Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0271b7d4-a3f6-411d-bda9-16ec65c911ba),volume_type_id=0271b7d4-a3f6-411d-bda9-16ec65c911ba)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Creating volume a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:34:58 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:34:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:58 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 1073741824 Sep 29 12:34:58 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:59 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 1073741824" returned: 0 in 0.685s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:34:59 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 Sep 29 12:34:59 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:34:59 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f7ae90-b634-4ca7-b6f8-65cd83149c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e60781d-924e-4b0c-a59b-1ab1c3917b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:34:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Volume volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 (a9fd7756-d02f-4917-aa9b-cbec005d5d79): created successfully Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e60781d-924e-4b0c-a59b-1ab1c3917b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:34:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (933639d8-abf8-4628-b03f-f3ff8a73c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:34:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e2190183-15c6-4f13-a852-3800ac00bfed tempest-GroupSnapshotsTest-1248204784 None] Created volume successfully. Sep 29 12:35:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-47bfdf54-8e70-4af8-8e91-871167f60b78 tempest-GroupSnapshotsTest-1248204784 None] Update group completed successfully. Sep 29 12:35:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-29ff4245-31e0-4c2a-b7e3-b973016cde7e tempest-GroupSnapshotsTest-1248204784 None] Update group completed successfully. Sep 29 12:35:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1d8656da-3975-45d7-9ec8-c9e490ce05a6 tempest-GroupSnapshotsTest-1248204784 None] Update group completed successfully. Sep 29 12:35:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0f7acc1f-6712-47cb-82c3-26f6c0922e9f tempest-GroupSnapshotsTest-1248204784 None] Update group completed successfully. Sep 29 12:35:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] GroupSnapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: creating. Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Group snapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Creating offline snapshot 0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 of volume a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7817b56-50be-48d5-a191-cb0d1b3856af]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:07 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 Sep 29 12:35:07 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:07 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79" returned: 0 in 0.535s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:07 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 1G Sep 29 12:35:07 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:08 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 1G" returned: 0 in 1.290s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:08 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 Sep 29 12:35:08 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:09 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" returned: 0 in 1.010s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:09 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:09 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 Sep 29 12:35:09 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:10 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" returned: 0 in 0.719s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:10 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info Sep 29 12:35:10 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:11 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info" returned: 0 in 0.581s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:11 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info Sep 29 12:35:11 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:11 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.info" returned: 0 in 0.430s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.754s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Creating offline snapshot 4f37441f-c931-472d-80e6-08e0c7b15bf3 of volume b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[778bdfa3-a946-4ca1-9d44-68ed5adbe4dd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:11 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd Sep 29 12:35:11 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:12 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd" returned: 0 in 0.931s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:12 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 1G Sep 29 12:35:12 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:13 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 1G" returned: 0 in 0.862s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:13 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 Sep 29 12:35:13 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:13 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3" returned: 0 in 0.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:13 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:13 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 Sep 29 12:35:13 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:14 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3" returned: 0 in 0.616s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:14 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info Sep 29 12:35:14 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:15 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info" returned: 0 in 0.550s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:15 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:15 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info Sep 29 12:35:15 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:15 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.info" returned: 0 in 0.683s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.358s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-48e42c4c-9356-4aff-bfdd-3a560229d75c tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: created successfully Sep 29 12:35:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: deleting Sep 29 12:35:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Deleting offline snapshot 0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 of volume a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] snapshot_file for this snap is: volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa2f8ed-8a3d-4485-8bf0-920fcda6fbb3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:17 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 Sep 29 12:35:17 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:17 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" returned: 0 in 0.529s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[81af144a-d4a9-4076-9ebb-4e9a7ff7c66b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:17 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 Sep 29 12:35:17 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:18 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79" returned: 0 in 0.446s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:18 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 Sep 29 12:35:18 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:18 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" returned: 0 in 0.420s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:18 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186 Sep 29 12:35:18 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:18 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79.0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-0e2f5eeb-3d41-43ab-8d65-04b2bcdcf186" released by "_delete_snapshot" :: held 1.845s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" released by "delete_snapshot" :: held 1.877s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=73,cinder:UPDATE=67,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-4f37441f-c931-472d-80e6-08e0c7b15bf3" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-4f37441f-c931-472d-80e6-08e0c7b15bf3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Deleting offline snapshot 4f37441f-c931-472d-80e6-08e0c7b15bf3 of volume b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] snapshot_file for this snap is: volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[772fc784-f766-4362-aadb-93bc729c7122]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:19 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 Sep 29 12:35:19 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:19 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3" returned: 0 in 0.402s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c36da-97da-4ff9-a03b-f947218c301c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:19 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd Sep 29 12:35:19 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:19 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd" returned: 0 in 0.395s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:19 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 Sep 29 12:35:19 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:20 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3" returned: 0 in 0.393s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:20 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3 Sep 29 12:35:20 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:20 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd.4f37441f-c931-472d-80e6-08e0c7b15bf3" returned: 0 in 0.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-4f37441f-c931-472d-80e6-08e0c7b15bf3" released by "_delete_snapshot" :: held 1.659s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" released by "delete_snapshot" :: held 1.688s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=82,cinder:UPDATE=60,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:35:20 devstack cinder-volume[86763]: WARNING cinder.quota [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1324629401 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1324629401, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:20 devstack cinder-volume[86763]: WARNING cinder.quota [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1324629401 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1324629401, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['ba86335e-aa3d-4703-b0fc-b3747df7ae2f', '83ecd20b-b4f3-4269-b31b-19b808a38c4c', '013930f3-0db4-400b-b791-7d3c7101839a', '4ffea98c-e868-4584-941d-3ae6deee9ca4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['251a24f8-7b9f-4f6f-bd6a-0c79137bffff', '49c45104-f9a4-49c7-8b55-a14e6356979a', '31b86637-de84-4f8e-a869-dc8232cec394', 'd179f15f-8d8e-4252-9ca9-d846dcd159d8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e4aa6170-5d0b-448f-aa0e-147b353c815b tempest-GroupSnapshotsTest-1248204784 None] group_snapshot 11de6510-b0a0-42b2-9aa4-c627cd44b50a: deleted successfully Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8c6a5-5250-4ddc-bdd5-f6d46a8df1f0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:22 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 Sep 29 12:35:22 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:22 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79" returned: 0 in 0.516s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:22 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79 Sep 29 12:35:22 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:23 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9fd7756-d02f-4917-aa9b-cbec005d5d79" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-a9fd7756-d02f-4917-aa9b-cbec005d5d79" released by "delete_volume" :: held 0.963s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7953a-6841-4d5d-8f6f-7a6ad92380cf]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:23 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd Sep 29 12:35:23 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:23 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd" returned: 0 in 0.488s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:23 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd Sep 29 12:35:23 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:24 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b00bf37c-e0f7-456f-9e18-02b52f2141dd" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-b00bf37c-e0f7-456f-9e18-02b52f2141dd" released by "delete_volume" :: held 0.987s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['8c251cb5-634e-44e0-b29d-d8c60b35fbfd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:24 devstack cinder-volume[86763]: WARNING cinder.quota [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1324629401 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1324629401, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['1f24bb21-7ebd-4813-aceb-90bd6e039532', '3a63c719-3909-489c-b882-ad5543faedb8', '4712e2a8-e107-4dff-be42-41269d8a374c', '7ca31bea-f577-4211-b588-eefe3077224b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['b30029c1-147b-443b-afce-0887226534df', 'b6ae3251-f0f8-417a-a851-57f88eed04e4', 'fc52882a-8aea-487d-8df8-cb125da6be16', '204e3300-5962-48c4-92fd-05cc0dacddd5'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:25 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:35:25 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:25 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:35:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8afab4c0-240c-4ea1-bda3-a5ad1d6694d4 tempest-GroupSnapshotsTest-1248204784 None] Delete group completed successfully. Sep 29 12:35:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6fc3a0c4-59db-4717-9751-91ef3a5bd713 tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-625073108: creating Sep 29 12:35:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6fc3a0c4-59db-4717-9751-91ef3a5bd713 tempest-GroupSnapshotsTest-1248204784 None] Group tempest-GroupSnapshotsTest-Group-625073108: created successfully Sep 29 12:35:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6fc3a0c4-59db-4717-9751-91ef3a5bd713 tempest-GroupSnapshotsTest-1248204784 None] Create group completed successfully. Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (53d20a9b-2283-4a25-8580-d2a650e0cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b44349b-6bfb-4854-9721-f1a90e2cfc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b44349b-6bfb-4854-9721-f1a90e2cfc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003990928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72f3e4a8-6409-4940-b333-37a3f462d1dc,host='devstack@QuobyteHD#QuobyteHD',id=db501dd4-cda2-47cb-9b76-45664a6653d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:30Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463e7fa3-ecad-4096-9b6d-9c04d3ec76fe),volume_type_id=463e7fa3-ecad-4096-9b6d-9c04d3ec76fe)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a042d0-7f7e-4a0b-9a65-e7ce95e48877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a042d0-7f7e-4a0b-9a65-e7ce95e48877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6bac70-70bf-4419-b5ea-824935e3fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6bac70-70bf-4419-b5ea-824935e3fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db501dd4-cda2-47cb-9b76-45664a6653d4', 'volume_name': 'volume-db501dd4-cda2-47cb-9b76-45664a6653d4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c7092-1bc3-473d-aaa4-782b5eb9569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c7092-1bc3-473d-aaa4-782b5eb9569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea1f22-e539-459d-b9bd-8ce7203fc8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Volume db501dd4-cda2-47cb-9b76-45664a6653d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db501dd4-cda2-47cb-9b76-45664a6653d4', 'volume_size': 1} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72f3e4a8-6409-4940-b333-37a3f462d1dc,created_at=2026-09-29T10:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003990928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72f3e4a8-6409-4940-b333-37a3f462d1dc,host='devstack@QuobyteHD#QuobyteHD',id=db501dd4-cda2-47cb-9b76-45664a6653d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5c1ec3b885421f82c62a0d9596d9f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:30Z,use_quota=True,user_id='cfc8d454eb7f4830999a2592602bb353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463e7fa3-ecad-4096-9b6d-9c04d3ec76fe),volume_type_id=463e7fa3-ecad-4096-9b6d-9c04d3ec76fe)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Creating volume db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:35:29 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:35:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:29 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 1073741824 Sep 29 12:35:29 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:30 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:35:30 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:30 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 1073741824" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:30 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.456s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 8 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:30 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 Sep 29 12:35:30 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:30 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4" returned: 0 in 0.315s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea1f22-e539-459d-b9bd-8ce7203fc8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db501dd4-cda2-47cb-9b76-45664a6653d4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ccfc17-8143-4d09-a5a3-4d8b117f9274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Volume volume-db501dd4-cda2-47cb-9b76-45664a6653d4 (db501dd4-cda2-47cb-9b76-45664a6653d4): created successfully Sep 29 12:35:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ccfc17-8143-4d09-a5a3-4d8b117f9274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Flow 'volume_create_manager' (53d20a9b-2283-4a25-8580-d2a650e0cc16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-896bc415-f504-4f76-b3e5-16bba107b7bf tempest-GroupSnapshotsTest-1248204784 None] Created volume successfully. Sep 29 12:35:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] GroupSnapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: creating. Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Group snapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Creating offline snapshot 454ec9c0-0893-4acc-a25b-1580aef8b066 of volume db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[74102215-1e2b-4b51-8b71-2260df7e3cff]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:32 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 Sep 29 12:35:32 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:32 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4" returned: 0 in 0.446s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:32 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 1G Sep 29 12:35:32 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:33 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 1G" returned: 0 in 0.580s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db501dd4-cda2-47cb-9b76-45664a6653d4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:33 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db501dd4-cda2-47cb-9b76-45664a6653d4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 Sep 29 12:35:33 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:33 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db501dd4-cda2-47cb-9b76-45664a6653d4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066" returned: 0 in 0.484s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:33 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:34 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 Sep 29 12:35:34 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:34 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:34 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info Sep 29 12:35:34 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9c74ea5b-6c3d-4479-a813-6ca59b30920c req-5c0e7f5b-1120-4031-98c0-eb9f3318f865 tempest-AttachVolumeNegativeTest-1839513264 None] Terminate volume connection completed successfully. Sep 29 12:35:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9c74ea5b-6c3d-4479-a813-6ca59b30920c req-5c0e7f5b-1120-4031-98c0-eb9f3318f865 tempest-AttachVolumeNegativeTest-1839513264 None] Deleting attachment 0227d604-5935-4bb6-b522-4f3c28ee3516. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:35:34 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info" returned: 0 in 0.431s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:34 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:35:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:34 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info Sep 29 12:35:34 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:35 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.info" returned: 0 in 0.324s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-df86bd7a-1bac-4fcf-867b-5ba2efdaa874 tempest-GroupSnapshotsTest-1248204784 None] group_snapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: created successfully Sep 29 12:35:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] group_snapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: deleting Sep 29 12:35:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] group_snapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-454ec9c0-0893-4acc-a25b-1580aef8b066" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-454ec9c0-0893-4acc-a25b-1580aef8b066" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Deleting offline snapshot 454ec9c0-0893-4acc-a25b-1580aef8b066 of volume db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] snapshot_file for this snap is: volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402e5dd-8b31-4af3-9584-4ee8f5a3406c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:36 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 Sep 29 12:35:36 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:36 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066" returned: 0 in 0.588s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db501dd4-cda2-47cb-9b76-45664a6653d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[968034f2-bd9f-47fe-9e6b-21ada612970e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:37 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 Sep 29 12:35:37 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:37 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4" returned: 0 in 0.716s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:37 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 Sep 29 12:35:37 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Flow 'volume_create_manager' (7d6355da-2163-4a7f-87c2-bed9d8518f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e5319-a2a6-4687-bee8-3e4a930bf4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e5319-a2a6-4687-bee8-3e4a930bf4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-664337124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2adcf6-078b-4b86-af7d-be3c86b29405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb2bce7abc64f0d83585eccdbc7e686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:38Z,use_quota=True,user_id='6865fcffcf9f48b9800b4eea7716d0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380afe1f-b959-408a-956f-4745814a01ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380afe1f-b959-408a-956f-4745814a01ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3394d0-53bc-4ede-851b-9ec669b9f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3394d0-53bc-4ede-851b-9ec669b9f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2adcf6-078b-4b86-af7d-be3c86b29405', 'volume_name': 'volume-1e2adcf6-078b-4b86-af7d-be3c86b29405', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06784e7a-dbeb-4749-904c-54e9fa3e7e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06784e7a-dbeb-4749-904c-54e9fa3e7e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334f32f5-4a97-4618-8974-26d748c4bdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Volume 1e2adcf6-078b-4b86-af7d-be3c86b29405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2adcf6-078b-4b86-af7d-be3c86b29405', 'volume_size': 1} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-664337124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2adcf6-078b-4b86-af7d-be3c86b29405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb2bce7abc64f0d83585eccdbc7e686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:38Z,use_quota=True,user_id='6865fcffcf9f48b9800b4eea7716d0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Creating volume 1e2adcf6-078b-4b86-af7d-be3c86b29405 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:35:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:38 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 1073741824 Sep 29 12:35:38 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:38 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066" returned: 0 in 0.628s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:38 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066 Sep 29 12:35:38 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:38 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4.454ec9c0-0893-4acc-a25b-1580aef8b066" returned: 0 in 0.560s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:38 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 1073741824" returned: 0 in 0.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-454ec9c0-0893-4acc-a25b-1580aef8b066" released by "_delete_snapshot" :: held 2.781s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" released by "delete_snapshot" :: held 2.842s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:39 devstack cinder-volume[86763]: WARNING cinder.quota [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1778321132 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1778321132, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:39 devstack cinder-volume[86763]: WARNING cinder.quota [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1778321132 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1778321132, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:39 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 Sep 29 12:35:39 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['40892722-bac0-4b95-9e71-2035e34d7df5', 'fee1b945-c137-40b4-8351-2b612d7ebd93', '05d018f9-4032-4a6d-a268-eadd41327f67', '576a8098-0078-43b1-b3e1-76657bd638b0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b0eb63d8-8014-4f21-b7eb-9ef158597a0c tempest-GroupSnapshotsTest-1248204784 None] group_snapshot b4efd40b-2654-42e2-94cd-58ca0b4e6909: deleted successfully Sep 29 12:35:39 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405" returned: 0 in 0.374s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334f32f5-4a97-4618-8974-26d748c4bdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2adcf6-078b-4b86-af7d-be3c86b29405', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2483d95b-5858-4fae-abae-33238d70a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Volume volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 (1e2adcf6-078b-4b86-af7d-be3c86b29405): created successfully Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2483d95b-5858-4fae-abae-33238d70a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Flow 'volume_create_manager' (7d6355da-2163-4a7f-87c2-bed9d8518f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-560a6aad-d62f-4608-bed2-bca50b69e7c3 tempest-ServerActionsTestOtherA-1845306863 None] Created volume successfully. Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8984abce-7043-4510-812a-717eb74159bb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:40 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 Sep 29 12:35:40 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:40 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4" returned: 0 in 0.483s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:40 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4 Sep 29 12:35:40 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:41 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db501dd4-cda2-47cb-9b76-45664a6653d4" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Lock "cinder-quobyte-db501dd4-cda2-47cb-9b76-45664a6653d4" released by "delete_volume" :: held 0.997s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['2732b837-d048-460f-920c-567a70c8dc21'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:41 devstack cinder-volume[86763]: WARNING cinder.quota [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1778321132 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1778321132, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Created reservations ['4dc71b94-3091-4d51-9082-eabf1fdc2a30', 'b606b99c-d769-4c08-bbc4-ee7b33605312', '8ee5391c-78ad-4a19-b344-c7bf94fa981c', 'fe1e84bf-b4c1-48bb-abbe-f45fc405d752'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:41 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:35:41 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:41 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:35:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-66aca105-0cbc-4156-9688-fd94bd70e89e tempest-GroupSnapshotsTest-1248204784 None] Delete group completed successfully. Sep 29 12:35:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=57,cinder:SELECT=51,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:35:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=49,cinder:INSERT=16,cinder:UPDATE=56 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (34f1bf52-459d-4241-b33a-01acfebdbb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7b3084-ef82-4315-a77c-29d72f2c9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7b3084-ef82-4315-a77c-29d72f2c9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130781394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8844e4-d99d-48fc-a947-be5ed35de4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:54Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f62171b-64ea-4383-a122-04e0cdd79884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f62171b-64ea-4383-a122-04e0cdd79884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1c8344-ab76-4d5f-a615-b898b0c8c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1c8344-ab76-4d5f-a615-b898b0c8c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8844e4-d99d-48fc-a947-be5ed35de4ac', 'volume_name': 'volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50194c-d0a5-4482-92af-f22798be0c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50194c-d0a5-4482-92af-f22798be0c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffdc061-4509-4ec5-a649-22680d99d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Volume fd8844e4-d99d-48fc-a947-be5ed35de4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac', 'volume_size': 1} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130781394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8844e4-d99d-48fc-a947-be5ed35de4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:54Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Creating volume fd8844e4-d99d-48fc-a947-be5ed35de4ac {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:35:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:35:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:54 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac 1073741824 Sep 29 12:35:54 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:55 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac 1073741824" returned: 0 in 0.926s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:35:55 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac Sep 29 12:35:55 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:35:55 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac" returned: 0 in 0.478s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffdc061-4509-4ec5-a649-22680d99d57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56636f39-1174-4e93-9cd8-faa9c37e4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:35:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Volume volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac (fd8844e4-d99d-48fc-a947-be5ed35de4ac): created successfully Sep 29 12:35:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56636f39-1174-4e93-9cd8-faa9c37e4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:35:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (34f1bf52-459d-4241-b33a-01acfebdbb30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:35:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9820877b-20b1-4ccd-87ac-5149c239b62c tempest-AttachVolumeTestJSON-960941537 None] Created volume successfully. Sep 29 12:35:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-024f13e8-11ec-40df-895c-59633a2bb4e8 req-028fd4ab-b04b-41a0-a8cd-c3ad9d881573 tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:35:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-024f13e8-11ec-40df-895c-59633a2bb4e8 req-028fd4ab-b04b-41a0-a8cd-c3ad9d881573 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:35:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-024f13e8-11ec-40df-895c-59633a2bb4e8 req-028fd4ab-b04b-41a0-a8cd-c3ad9d881573 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:35:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-024f13e8-11ec-40df-895c-59633a2bb4e8 req-028fd4ab-b04b-41a0-a8cd-c3ad9d881573 tempest-AttachVolumeTestJSON-960941537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '304e7e11-6d3f-43c1-9736-e02027b460a0', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:35:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-024f13e8-11ec-40df-895c-59633a2bb4e8 req-028fd4ab-b04b-41a0-a8cd-c3ad9d881573 tempest-AttachVolumeTestJSON-960941537 None] attachment_update completed successfully. Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (51e03414-2d5f-454c-90e5-4c2e5773efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbc9435-f17e-4ede-80ed-c2593b62b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbc9435-f17e-4ede-80ed-c2593b62b326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1136124899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fea20b-1fdb-434b-8b35-52f75fceded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:02Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3690cf53-1ac2-4430-802a-37f30c198d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3690cf53-1ac2-4430-802a-37f30c198d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f90411-5a3f-4a06-83c1-e2870b68b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f90411-5a3f-4a06-83c1-e2870b68b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fea20b-1fdb-434b-8b35-52f75fceded3', 'volume_name': 'volume-55fea20b-1fdb-434b-8b35-52f75fceded3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b6cf12-517e-4043-beb9-825198160601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b6cf12-517e-4043-beb9-825198160601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37bf28c-7015-49ab-bb33-972eeab9b2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Volume 55fea20b-1fdb-434b-8b35-52f75fceded3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fea20b-1fdb-434b-8b35-52f75fceded3', 'volume_size': 1} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1136124899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fea20b-1fdb-434b-8b35-52f75fceded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d43534690924ef3ae76fd3c72a958c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:02Z,use_quota=True,user_id='5bcd85f36b684bc2bef7a76be0e18176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Creating volume 55fea20b-1fdb-434b-8b35-52f75fceded3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:02 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 1073741824 Sep 29 12:36:02 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:02 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 1073741824" returned: 0 in 0.642s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:02 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 Sep 29 12:36:02 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:03 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3" returned: 0 in 0.429s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37bf28c-7015-49ab-bb33-972eeab9b2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fea20b-1fdb-434b-8b35-52f75fceded3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befe6cef-3a69-45ab-bedf-b3c62b5510f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Volume volume-55fea20b-1fdb-434b-8b35-52f75fceded3 (55fea20b-1fdb-434b-8b35-52f75fceded3): created successfully Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befe6cef-3a69-45ab-bedf-b3c62b5510f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Flow 'volume_create_manager' (51e03414-2d5f-454c-90e5-4c2e5773efd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-01773d44-1fc8-4e8c-960d-bc84e60589a0 tempest-AttachVolumeTestJSON-960941537 None] Created volume successfully. Sep 29 12:36:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-61021849-8613-4ee8-804c-c3e66e1057fe req-7d623590-7e4a-4307-880e-478ce1e7c11e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-61021849-8613-4ee8-804c-c3e66e1057fe req-7d623590-7e4a-4307-880e-478ce1e7c11e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-61021849-8613-4ee8-804c-c3e66e1057fe req-7d623590-7e4a-4307-880e-478ce1e7c11e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-61021849-8613-4ee8-804c-c3e66e1057fe req-7d623590-7e4a-4307-880e-478ce1e7c11e tempest-AttachVolumeTestJSON-960941537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-55fea20b-1fdb-434b-8b35-52f75fceded3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29d201ce-cb8d-4bd8-b1e2-d85d44c2aaf0', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:36:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-61021849-8613-4ee8-804c-c3e66e1057fe req-7d623590-7e4a-4307-880e-478ce1e7c11e tempest-AttachVolumeTestJSON-960941537 None] attachment_update completed successfully. Sep 29 12:36:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-28803847-c4ca-4965-85a9-dbb159d965f8 req-71bad2d0-335d-4efd-be75-261b4a6fe9a3 tempest-AttachVolumeTestJSON-960941537 None] Terminate volume connection completed successfully. Sep 29 12:36:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-28803847-c4ca-4965-85a9-dbb159d965f8 req-71bad2d0-335d-4efd-be75-261b4a6fe9a3 tempest-AttachVolumeTestJSON-960941537 None] Deleting attachment 304e7e11-6d3f-43c1-9736-e02027b460a0. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:36:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-5cd9b132-ec96-455c-95e9-ae44aadcfe0a req-c1bf1654-fad2-48ce-bf42-203bc0230860 tempest-AttachVolumeTestJSON-960941537 None] Terminate volume connection completed successfully. Sep 29 12:36:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-5cd9b132-ec96-455c-95e9-ae44aadcfe0a req-c1bf1654-fad2-48ce-bf42-203bc0230860 tempest-AttachVolumeTestJSON-960941537 None] Deleting attachment 29d201ce-cb8d-4bd8-b1e2-d85d44c2aaf0. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:36:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Flow 'volume_create_manager' (280669db-5944-44d2-8d80-502c3ccfe9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5f8168-0f02-47f5-a7c6-a2e4555efb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5f8168-0f02-47f5-a7c6-a2e4555efb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-901344753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2b5916-0b75-435f-bdae-e5f335e5fbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938d21a91b6c4d729cd2b83c2fec9dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:15Z,use_quota=True,user_id='95b4db5075dd4104a87a88255e8db4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4591dbf0-abb3-4c5e-91ff-0f4f9dfffc4f),volume_type_id=4591dbf0-abb3-4c5e-91ff-0f4f9dfffc4f)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfcedd8-0b99-4c85-8953-402a879478ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfcedd8-0b99-4c85-8953-402a879478ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3293402-4e96-46a9-84b8-d791c8075558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3293402-4e96-46a9-84b8-d791c8075558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2b5916-0b75-435f-bdae-e5f335e5fbda', 'volume_name': 'volume-db2b5916-0b75-435f-bdae-e5f335e5fbda', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e454e7-9581-4981-9418-a3275c934238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e454e7-9581-4981-9418-a3275c934238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cf0ad4-f6b5-4d0f-ab20-0080fbed1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Volume db2b5916-0b75-435f-bdae-e5f335e5fbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2b5916-0b75-435f-bdae-e5f335e5fbda', 'volume_size': 1} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-901344753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2b5916-0b75-435f-bdae-e5f335e5fbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938d21a91b6c4d729cd2b83c2fec9dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:15Z,use_quota=True,user_id='95b4db5075dd4104a87a88255e8db4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4591dbf0-abb3-4c5e-91ff-0f4f9dfffc4f),volume_type_id=4591dbf0-abb3-4c5e-91ff-0f4f9dfffc4f)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Creating volume db2b5916-0b75-435f-bdae-e5f335e5fbda {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:15 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda 1073741824 Sep 29 12:36:15 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:15 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda 1073741824" returned: 0 in 0.512s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:15 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda Sep 29 12:36:15 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:15 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cf0ad4-f6b5-4d0f-ab20-0080fbed1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2b5916-0b75-435f-bdae-e5f335e5fbda', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfec85a-0dfb-4264-a9ed-bfae1115386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Volume volume-db2b5916-0b75-435f-bdae-e5f335e5fbda (db2b5916-0b75-435f-bdae-e5f335e5fbda): created successfully Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfec85a-0dfb-4264-a9ed-bfae1115386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Flow 'volume_create_manager' (280669db-5944-44d2-8d80-502c3ccfe9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-11df3fe0-72ad-4ccb-9f20-218afb52d512 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Created volume successfully. Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-55fea20b-1fdb-434b-8b35-52f75fceded3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-55fea20b-1fdb-434b-8b35-52f75fceded3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-quobyte-55fea20b-1fdb-434b-8b35-52f75fceded3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-55fea20b-1fdb-434b-8b35-52f75fceded3" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c2b1d7-a087-4091-a4d5-60d6d1966dd0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:16 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 Sep 29 12:36:16 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d8633ee2-5559-492b-984a-1e2400f9203e req-d72d08b3-a706-41c1-b622-7f61ff12bbf2 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d8633ee2-5559-492b-984a-1e2400f9203e req-d72d08b3-a706-41c1-b622-7f61ff12bbf2 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d8633ee2-5559-492b-984a-1e2400f9203e req-d72d08b3-a706-41c1-b622-7f61ff12bbf2 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d8633ee2-5559-492b-984a-1e2400f9203e req-d72d08b3-a706-41c1-b622-7f61ff12bbf2 tempest-ServerActionsTestOtherA-1845306863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-1e2adcf6-078b-4b86-af7d-be3c86b29405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90a82cb5-5316-47cc-8e2a-effc6bb1a51a', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:36:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d8633ee2-5559-492b-984a-1e2400f9203e req-d72d08b3-a706-41c1-b622-7f61ff12bbf2 tempest-ServerActionsTestOtherA-1845306863 None] attachment_update completed successfully. Sep 29 12:36:16 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:16 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3 Sep 29 12:36:16 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:16 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55fea20b-1fdb-434b-8b35-52f75fceded3" returned: 0 in 0.289s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-55fea20b-1fdb-434b-8b35-52f75fceded3" released by "delete_volume" :: held 0.784s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Created reservations ['a2e4ef95-522d-461b-89c0-0e029445bf27', '2109440f-2627-44dd-b397-2b9d43c9277e', '5c0b2437-7f80-447c-ad0b-c1e49af2a690', '73bb09f8-4898-44d9-8748-5fc735b6110a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:17 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:17 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:17 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Deleted volume successfully. Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-fd8844e4-d99d-48fc-a947-be5ed35de4ac-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c78e971d-80e4-4ff3-bb50-e75bffe57dbf tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-55fea20b-1fdb-434b-8b35-52f75fceded3-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-fd8844e4-d99d-48fc-a947-be5ed35de4ac-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-quobyte-fd8844e4-d99d-48fc-a947-be5ed35de4ac" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-fd8844e4-d99d-48fc-a947-be5ed35de4ac" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[84680ad6-57eb-408a-a109-e4cc213a848c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:17 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac Sep 29 12:36:17 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:18 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:18 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:18 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:18 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac Sep 29 12:36:18 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:18 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3765a51a-6f07-403c-bd8b-fb83fb04ffd6 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Retype volume completed successfully. Sep 29 12:36:18 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fd8844e4-d99d-48fc-a947-be5ed35de4ac" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-fd8844e4-d99d-48fc-a947-be5ed35de4ac" released by "delete_volume" :: held 0.760s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Created reservations ['29958d2f-ea20-4364-b9b3-c5933853a75d', '232dea6f-5002-4dd1-838b-de3007f5c211', 'ad677812-0993-4bbb-982b-9ba66507493f', '5a536ad7-053b-43da-8342-a127ab0950ba'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:18 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:18 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "cinder-quobyte-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:19 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.456s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Deleted volume successfully. Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae0d35-03a0-43d6-a5df-b7858ff8144e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d2f0baf8-7446-4c5a-8773-056555e4446e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-fd8844e4-d99d-48fc-a947-be5ed35de4ac-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:19 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 Sep 29 12:36:19 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "cinder-db2b5916-0b75-435f-bdae-e5f335e5fbda-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "cinder-db2b5916-0b75-435f-bdae-e5f335e5fbda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "cinder-quobyte-db2b5916-0b75-435f-bdae-e5f335e5fbda" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "cinder-quobyte-db2b5916-0b75-435f-bdae-e5f335e5fbda" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c471981-3090-4fc3-9163-de2c3f2871f1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:19 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:19 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66 Sep 29 12:36:19 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:19 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda Sep 29 12:36:19 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:20 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" returned: 0 in 0.406s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-quobyte-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66" released by "delete_volume" :: held 0.950s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:20 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda" returned: 0 in 0.528s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:20 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda Sep 29 12:36:20 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Created reservations ['60deb8f7-58e5-4aef-8f88-d80252507269', 'fe59d6ee-59b4-4e75-9786-9ec2c97de88c', '2185ec5c-1e4b-4d7c-a215-e61c34117b38', 'dbeb0408-1c07-44f9-9496-7de6ec3a5a9a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:20 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:20 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:20 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db2b5916-0b75-435f-bdae-e5f335e5fbda" returned: 0 in 0.365s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "cinder-quobyte-db2b5916-0b75-435f-bdae-e5f335e5fbda" released by "delete_volume" :: held 0.943s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:20 devstack cinder-volume[86763]: WARNING cinder.quota [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:36:20 devstack cinder-volume[86763]: WARNING cinder.quota [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Created reservations ['7f0e716b-bfb4-42ac-8831-141bf9ca3425', 'e5f5047e-220c-4f60-902f-e5675634a34b', '9e25acec-aa91-43dc-b8be-36c989ab7032', '0ab00d8f-c4ac-41f5-a2e1-7ec97f25aaa4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:20 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:20 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:20 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.441s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Deleted volume successfully. Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57449e34-9b41-4217-8dc0-76b0bbbf407e tempest-AttachVolumeTestJSON-960941537 None] Lock "cinder-4bb4a3d8-f50b-4a1e-b7e0-16f554538d66-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:20 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.332s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Deleted volume successfully. Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40efa1d7-36f2-4553-8e72-6ec09d964b53 tempest-VolumeRetypeWithoutMigrationTest-2122403941 None] Lock "cinder-db2b5916-0b75-435f-bdae-e5f335e5fbda-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-0286f710-44fc-4fd8-91ac-a92ec6aab231 tempest-ServerActionsTestOtherA-1845306863 None] Terminate volume connection completed successfully. Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-0286f710-44fc-4fd8-91ac-a92ec6aab231 tempest-ServerActionsTestOtherA-1845306863 None] Deleting attachment 90a82cb5-5316-47cc-8e2a-effc6bb1a51a. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (00aaecbc-35c1-4acc-a1fe-bfdaaadd4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc1e5d-09a8-4be6-adb2-89e7059028a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc1e5d-09a8-4be6-adb2-89e7059028a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1314926941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e430b94-cc76-463e-a61c-59c0edb2d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:21Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ca8c38-f795-4eb9-96b4-20fb4026b4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ca8c38-f795-4eb9-96b4-20fb4026b4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb8c36-7aec-4b5f-a365-21c59d814e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb8c36-7aec-4b5f-a365-21c59d814e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e430b94-cc76-463e-a61c-59c0edb2d55f', 'volume_name': 'volume-7e430b94-cc76-463e-a61c-59c0edb2d55f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cff729-0e93-4a7a-a21c-1c8e7f038459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cff729-0e93-4a7a-a21c-1c8e7f038459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7539a8cc-04c7-4527-a494-40225e05627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Volume 7e430b94-cc76-463e-a61c-59c0edb2d55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e430b94-cc76-463e-a61c-59c0edb2d55f', 'volume_size': 1} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1314926941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e430b94-cc76-463e-a61c-59c0edb2d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:21Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Creating volume 7e430b94-cc76-463e-a61c-59c0edb2d55f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:21 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f 1073741824 Sep 29 12:36:21 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-b8071a4c-7515-41a2-b9db-089a3d57adad tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:22 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f 1073741824" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:22 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f Sep 29 12:36:22 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:22 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f" returned: 0 in 0.346s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-b8071a4c-7515-41a2-b9db-089a3d57adad tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.443s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-b8071a4c-7515-41a2-b9db-089a3d57adad tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7539a8cc-04c7-4527-a494-40225e05627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e430b94-cc76-463e-a61c-59c0edb2d55f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46c7add-9f29-4a7b-823b-540f52147e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Volume volume-7e430b94-cc76-463e-a61c-59c0edb2d55f (7e430b94-cc76-463e-a61c-59c0edb2d55f): created successfully Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46c7add-9f29-4a7b-823b-540f52147e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (00aaecbc-35c1-4acc-a1fe-bfdaaadd4eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-b8071a4c-7515-41a2-b9db-089a3d57adad tempest-ServerActionsTestOtherA-1845306863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-1e2adcf6-078b-4b86-af7d-be3c86b29405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28f18468-07f5-4f61-974a-af2a82fa75f8', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:36:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-513a742a-9448-49a6-90a8-6f1b3347403d tempest-AttachVolumeNegativeTest-1839513264 None] Created volume successfully. Sep 29 12:36:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-13e7d020-b65c-4c06-86e8-0dd1a6b25f66 req-b8071a4c-7515-41a2-b9db-089a3d57adad tempest-ServerActionsTestOtherA-1845306863 None] attachment_update completed successfully. Sep 29 12:36:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-26db8979-e57e-49ae-bc7b-f9ce8e5eddd2 req-52c78049-9f6b-4fe7-9a71-b1eeb7450ab2 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-26db8979-e57e-49ae-bc7b-f9ce8e5eddd2 req-52c78049-9f6b-4fe7-9a71-b1eeb7450ab2 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-26db8979-e57e-49ae-bc7b-f9ce8e5eddd2 req-52c78049-9f6b-4fe7-9a71-b1eeb7450ab2 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.087s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-26db8979-e57e-49ae-bc7b-f9ce8e5eddd2 req-52c78049-9f6b-4fe7-9a71-b1eeb7450ab2 tempest-AttachVolumeNegativeTest-1839513264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-7e430b94-cc76-463e-a61c-59c0edb2d55f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2112977b-2130-4ff2-97d8-8709ede28b71', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:36:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-26db8979-e57e-49ae-bc7b-f9ce8e5eddd2 req-52c78049-9f6b-4fe7-9a71-b1eeb7450ab2 tempest-AttachVolumeNegativeTest-1839513264 None] attachment_update completed successfully. Sep 29 12:36:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-328616f2-a37c-4749-82c6-7bf75c95813f req-3de1d1f4-65a9-4571-a949-73e4a0b8660a tempest-AttachVolumeNegativeTest-1839513264 None] Terminate volume connection completed successfully. Sep 29 12:36:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-328616f2-a37c-4749-82c6-7bf75c95813f req-3de1d1f4-65a9-4571-a949-73e4a0b8660a tempest-AttachVolumeNegativeTest-1839513264 None] Deleting attachment 2112977b-2130-4ff2-97d8-8709ede28b71. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:30 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:30 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:30 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.717s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 8 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:36:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Flow 'volume_create_manager' (f8f1ccbe-ccbe-451d-a909-93297dd537ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dedabbd-04d6-4eb5-b10a-bc6bf9210913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dedabbd-04d6-4eb5-b10a-bc6bf9210913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-452474586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8acfee-f593-4b59-92a3-946e0f879f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c81368d8b14e419b4222615b6b0f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:34Z,use_quota=True,user_id='715abc3ecce94a208a4c6adb0cca7a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b54f16-7c0f-4f59-94ab-8387f5096ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b54f16-7c0f-4f59-94ab-8387f5096ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a771c2a-70f8-499d-b2ec-eb7ebb9401d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a771c2a-70f8-499d-b2ec-eb7ebb9401d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8acfee-f593-4b59-92a3-946e0f879f6d', 'volume_name': 'volume-5c8acfee-f593-4b59-92a3-946e0f879f6d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664afbb-1899-4cf3-915f-3be3d5050d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664afbb-1899-4cf3-915f-3be3d5050d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cb5956-4080-4660-8c8e-448bcb0c9a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Volume 5c8acfee-f593-4b59-92a3-946e0f879f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8acfee-f593-4b59-92a3-946e0f879f6d', 'volume_size': 1} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-452474586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8acfee-f593-4b59-92a3-946e0f879f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c81368d8b14e419b4222615b6b0f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:34Z,use_quota=True,user_id='715abc3ecce94a208a4c6adb0cca7a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Creating volume 5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:34 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d 1073741824 Sep 29 12:36:34 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:34 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d 1073741824" returned: 0 in 0.556s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:35 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d Sep 29 12:36:35 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:35 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d" returned: 0 in 0.387s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cb5956-4080-4660-8c8e-448bcb0c9a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8acfee-f593-4b59-92a3-946e0f879f6d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49729e8b-9c1d-4a3d-ae4c-2178e501eca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Volume volume-5c8acfee-f593-4b59-92a3-946e0f879f6d (5c8acfee-f593-4b59-92a3-946e0f879f6d): created successfully Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49729e8b-9c1d-4a3d-ae4c-2178e501eca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Flow 'volume_create_manager' (f8f1ccbe-ccbe-451d-a909-93297dd537ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-278e4176-cbc8-4f12-a4d9-48f4d71b8215 req-840258ba-c3d0-474e-836e-d079dd5cca75 tempest-VolumesSnapshotsTestJSON-1702909578 None] Created volume successfully. Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Creating offline snapshot e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 of volume 5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f84f68-0e9a-4ae3-87ec-3c8ac09c022e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:37 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d Sep 29 12:36:37 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:37 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d" returned: 0 in 0.669s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:37 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 1G Sep 29 12:36:37 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:38 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 1G" returned: 0 in 0.634s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8acfee-f593-4b59-92a3-946e0f879f6d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:38 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8acfee-f593-4b59-92a3-946e0f879f6d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 Sep 29 12:36:38 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:38 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8acfee-f593-4b59-92a3-946e0f879f6d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" returned: 0 in 0.381s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:38 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 is being set with open permissions: ugo+rw Sep 29 12:36:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:38 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 Sep 29 12:36:38 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:39 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" returned: 0 in 0.292s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:39 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info Sep 29 12:36:39 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:39 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info" returned: 0 in 0.453s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:39 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info is being set with open permissions: ugo+rw Sep 29 12:36:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:39 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info Sep 29 12:36:39 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:40 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.info" returned: 0 in 0.299s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.863s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-3eba6010-64e2-4f08-b503-fc4ad6a3a0cb req-1ff498bf-94bd-4102-978c-168ae5a89f20 tempest-VolumesSnapshotsTestJSON-1702909578 None] Create snapshot completed successfully Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "cinder-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "cinder-quobyte-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Deleting offline snapshot e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 of volume 5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] snapshot_file for this snap is: volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fef42d-bff9-455b-97a6-9f4ac4955b7d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:40 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 Sep 29 12:36:40 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:41 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" returned: 0 in 0.563s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8acfee-f593-4b59-92a3-946e0f879f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb7bafa-a1d4-41f3-8111-a0d2560417dd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:41 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d Sep 29 12:36:41 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:41 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d" returned: 0 in 0.553s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:41 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 Sep 29 12:36:41 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:42 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" returned: 0 in 0.439s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:42 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50 Sep 29 12:36:42 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:42 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d.e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50" released by "_delete_snapshot" :: held 2.007s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" released by "delete_snapshot" :: held 2.040s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:42 devstack cinder-volume[86763]: WARNING cinder.quota [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.quota [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Created reservations ['f25297e6-4863-471d-8f11-9e11cbd6547f', '7fe2183a-b9c1-4b2d-98c5-845cf12b5427', '99e0bf4e-99e9-4a53-b250-d85487de96ef', '0ad9d1e7-1f5e-4914-9089-a42e1bcb4282'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Delete snapshot completed successfully. Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-c134f95b-04c3-4659-948b-6e73e7e63e76 req-df592e7e-b53b-43a3-bf07-858d45c598bc tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-e7dd0d0d-cc98-45b9-9c63-dc75a21afc50-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "cinder-5c8acfee-f593-4b59-92a3-946e0f879f6d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-5c8acfee-f593-4b59-92a3-946e0f879f6d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e7e146-31b6-470f-9cd6-3198c896676c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:43 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d Sep 29 12:36:43 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:43 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d" returned: 0 in 0.481s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:43 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d Sep 29 12:36:43 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:43 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c8acfee-f593-4b59-92a3-946e0f879f6d" returned: 0 in 0.370s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-quobyte-5c8acfee-f593-4b59-92a3-946e0f879f6d" released by "delete_volume" :: held 0.979s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:43 devstack cinder-volume[86763]: DEBUG cinder.quota [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Created reservations ['57386ba0-1350-4592-a926-e7f845ee5cef', '83a02fb3-fe7d-4c57-bef2-96599227e810', '4996d8f8-5767-453e-a92e-f37537464dd5', 'b39b71dc-7b6b-4afa-95d4-a4c751116884'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:44 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:36:44 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:44 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG cinder.manager [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:36:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Deleted volume successfully. Sep 29 12:36:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-b3b8643a-2280-4c3c-ae09-ee23e9abec06 req-85930d02-b654-4d40-ba57-946e5d443e18 tempest-VolumesSnapshotsTestJSON-1702909578 None] Lock "cinder-5c8acfee-f593-4b59-92a3-946e0f879f6d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:36:49 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (c458ab56-5a22-4a9e-bba4-2999a71c598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011614c6-1893-4007-8818-a2bb9ebe3541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011614c6-1893-4007-8818-a2bb9ebe3541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899502440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2d6bae-b960-4f4b-9712-b89c565604d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:50Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6872f6d6-a02a-4dd2-82a2-ed3b743538c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6872f6d6-a02a-4dd2-82a2-ed3b743538c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b362d58-3294-467b-8915-ec3efb038b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b362d58-3294-467b-8915-ec3efb038b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2d6bae-b960-4f4b-9712-b89c565604d7', 'volume_name': 'volume-1e2d6bae-b960-4f4b-9712-b89c565604d7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb0b4bb-3c71-4b3f-9dc2-91320c2610f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb0b4bb-3c71-4b3f-9dc2-91320c2610f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9c20d8-6692-437b-a3d0-6c6d61f93b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Volume 1e2d6bae-b960-4f4b-9712-b89c565604d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2d6bae-b960-4f4b-9712-b89c565604d7', 'volume_size': 1} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899502440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2d6bae-b960-4f4b-9712-b89c565604d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:50Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Creating volume 1e2d6bae-b960-4f4b-9712-b89c565604d7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:50 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:50 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 1073741824 Sep 29 12:36:50 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:51 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 1073741824" returned: 0 in 0.949s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:51 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 Sep 29 12:36:51 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:51 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7" returned: 0 in 0.353s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=95,cinder:UPDATE=74,cinder:DELETE=8,cinder:INSERT=16 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9c20d8-6692-437b-a3d0-6c6d61f93b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2d6bae-b960-4f4b-9712-b89c565604d7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60d699b-1f69-4fa0-948b-8dacfc3b41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=85,cinder:UPDATE=80,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:36:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Volume volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 (1e2d6bae-b960-4f4b-9712-b89c565604d7): created successfully Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60d699b-1f69-4fa0-948b-8dacfc3b41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (c458ab56-5a22-4a9e-bba4-2999a71c598a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8f48118c-6ef0-4174-9e75-531948160816 tempest-VolumesTestJSON-1292254296 None] Created volume successfully. Sep 29 12:36:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d5ece1cf-0de9-4403-b9b7-d0f68b78cb86 req-793841c3-1659-4ae4-b999-0e2ac9566c62 tempest-ServerActionsTestOtherA-1845306863 None] Terminate volume connection completed successfully. Sep 29 12:36:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d5ece1cf-0de9-4403-b9b7-d0f68b78cb86 req-793841c3-1659-4ae4-b999-0e2ac9566c62 tempest-ServerActionsTestOtherA-1845306863 None] Deleting attachment 28f18468-07f5-4f61-974a-af2a82fa75f8. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (6a2b4f79-81c9-410d-8c1e-f2ea0c0f8b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674f836b-cf20-46bc-97c4-5e5aaee0790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674f836b-cf20-46bc-97c4-5e5aaee0790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1520573588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506ab3d6-742d-4679-acf3-2dcfb398fd9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:53Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2947fa7c-a009-43ba-b18a-1dbd771770b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2947fa7c-a009-43ba-b18a-1dbd771770b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543fe42a-ba0a-495b-b980-7056b14b0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543fe42a-ba0a-495b-b980-7056b14b0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506ab3d6-742d-4679-acf3-2dcfb398fd9e', 'volume_name': 'volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c705a943-cf01-4fc6-92fb-30582ea7cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c705a943-cf01-4fc6-92fb-30582ea7cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f1d220-1502-4f39-a7d5-2a0df20cb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Volume 506ab3d6-742d-4679-acf3-2dcfb398fd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e', 'volume_size': 1} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1520573588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506ab3d6-742d-4679-acf3-2dcfb398fd9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:53Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Creating volume 506ab3d6-742d-4679-acf3-2dcfb398fd9e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:53 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:53 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e 1073741824 Sep 29 12:36:53 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:54 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e 1073741824" returned: 0 in 0.713s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:54 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e Sep 29 12:36:54 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:54 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e" returned: 0 in 0.522s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f1d220-1502-4f39-a7d5-2a0df20cb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7393cc6e-df07-43ed-a87b-7f740fb89558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Volume volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e (506ab3d6-742d-4679-acf3-2dcfb398fd9e): created successfully Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7393cc6e-df07-43ed-a87b-7f740fb89558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (6a2b4f79-81c9-410d-8c1e-f2ea0c0f8b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5d86e6f8-50c7-487c-944f-c9c1559e5f26 tempest-VolumesTestJSON-1292254296 None] Created volume successfully. Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Flow 'volume_create_manager' (0d706fa4-5394-4d05-a6fe-9a79b61eb991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a096d-7e12-443a-b90f-2ac1f061be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a096d-7e12-443a-b90f-2ac1f061be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-411633743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924b1b0-07fe-4512-9506-6de2aa8e89fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51526ea667864c5a97aaa770949a9796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='48c1da9d6ed24b1a8cc1cbfc7358c89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f474cd3e-d3d6-428c-aa11-7843a7db807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f474cd3e-d3d6-428c-aa11-7843a7db807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aff43ee-03e2-469b-b5e2-29545a605eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aff43ee-03e2-469b-b5e2-29545a605eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8924b1b0-07fe-4512-9506-6de2aa8e89fa', 'volume_name': 'volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc31c2b4-5b65-4408-a5ad-9cdffa7e62fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc31c2b4-5b65-4408-a5ad-9cdffa7e62fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b0591e-72d5-4cc9-90e8-fda1d8f119e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Volume 8924b1b0-07fe-4512-9506-6de2aa8e89fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa', 'volume_size': 1} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-411633743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924b1b0-07fe-4512-9506-6de2aa8e89fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51526ea667864c5a97aaa770949a9796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='48c1da9d6ed24b1a8cc1cbfc7358c89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Creating volume 8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:55 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:56 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa 1073741824 Sep 29 12:36:56 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (bf6132f5-b5d6-4b20-8c70-fa91da5f81cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de05d49e-4c6d-43c7-89c8-a031f24b0530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de05d49e-4c6d-43c7-89c8-a031f24b0530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1114539620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b535b4-17d2-4b00-b55a-2c24a3d4bbc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500ab7d4-05dc-4ae2-82c4-ce7ed7486db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500ab7d4-05dc-4ae2-82c4-ce7ed7486db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac6d405-7e1f-4c28-80ff-2e3f9e55f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac6d405-7e1f-4c28-80ff-2e3f9e55f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b535b4-17d2-4b00-b55a-2c24a3d4bbc6', 'volume_name': 'volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139bb501-3228-4e4c-85df-2e931e9f5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139bb501-3228-4e4c-85df-2e931e9f5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed0d945-b73c-45ee-b1f1-365639fc7337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Volume 13b535b4-17d2-4b00-b55a-2c24a3d4bbc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6', 'volume_size': 1} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:56 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa 1073741824" returned: 0 in 0.630s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:56 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa Sep 29 12:36:56 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:56 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa" returned: 0 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1114539620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b535b4-17d2-4b00-b55a-2c24a3d4bbc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f78cba424d442cd90f0611516443eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='02afafec94934977ae37d6c7d53f2486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Creating volume 13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:36:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b0591e-72d5-4cc9-90e8-fda1d8f119e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:57 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 1073741824 Sep 29 12:36:57 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244f242c-a250-429b-90f5-067bf4036d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Volume volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa (8924b1b0-07fe-4512-9506-6de2aa8e89fa): created successfully Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244f242c-a250-429b-90f5-067bf4036d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Flow 'volume_create_manager' (0d706fa4-5394-4d05-a6fe-9a79b61eb991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3c7e6cd0-1633-449c-96bd-70c6cc1d9a1f tempest-SnapshotMetadataTestJSON-16756271 None] Created volume successfully. Sep 29 12:36:57 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 1073741824" returned: 0 in 0.503s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:57 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 Sep 29 12:36:57 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:57 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" returned: 0 in 0.292s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed0d945-b73c-45ee-b1f1-365639fc7337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8cd46c-0c8f-41d5-99e1-7f6a17c45124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Volume volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 (13b535b4-17d2-4b00-b55a-2c24a3d4bbc6): created successfully Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8cd46c-0c8f-41d5-99e1-7f6a17c45124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Flow 'volume_create_manager' (bf6132f5-b5d6-4b20-8c70-fa91da5f81cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f38f3157-a332-4cf0-9d97-502bbba2ddcf tempest-VolumesTestJSON-1292254296 None] Created volume successfully. Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Creating offline snapshot ee967f04-b7c8-4fdd-9748-33ac071864d4 of volume 8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0fa0f-1b29-4511-bc93-ed7acb5eed53]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:58 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa Sep 29 12:36:58 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:58 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa" returned: 0 in 0.450s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:58 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 1G Sep 29 12:36:58 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:59 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 1G" returned: 0 in 0.569s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:59 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 Sep 29 12:36:59 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:59 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4" returned: 0 in 0.487s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 is being set with open permissions: ugo+rw Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:59 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 Sep 29 12:36:59 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-quobyte-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Flow 'volume_create_manager' (ba2bcee2-e447-488a-aaf6-e1f6731db2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c860510-2868-4f9a-b9f4-593608e62a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ad503-dc64-406d-afaa-520f687cf1f8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c860510-2868-4f9a-b9f4-593608e62a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988255367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013cf800-f12f-4845-80ad-7a9c9a5483f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb2bce7abc64f0d83585eccdbc7e686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:00Z,use_quota=True,user_id='6865fcffcf9f48b9800b4eea7716d0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53402e20-18a1-4351-8d33-871d2f83f912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53402e20-18a1-4351-8d33-871d2f83f912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff84cd7-79f3-48a6-ae96-c5cbd19a788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:36:59 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 29 12:36:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4" returned: 0 in 0.316s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:36:59 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 Sep 29 12:36:59 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:00 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info Sep 29 12:37:00 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:00 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:00 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6 Sep 29 12:37:00 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:00 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff84cd7-79f3-48a6-ae96-c5cbd19a788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '013cf800-f12f-4845-80ad-7a9c9a5483f9', 'volume_name': 'volume-013cf800-f12f-4845-80ad-7a9c9a5483f9', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a61a32-805f-48d5-ad3e-5644c3ae9605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a61a32-805f-48d5-ad3e-5644c3ae9605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ae3a9-1a95-41e0-b5ae-6e95f869b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Volume 013cf800-f12f-4845-80ad-7a9c9a5483f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-013cf800-f12f-4845-80ad-7a9c9a5483f9', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Trying to clone 013cf800-f12f-4845-80ad-7a9c9a5483f9 from image 94feb733-57cd-4052-a12a-6ab2ace34da5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info" returned: 0 in 0.424s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:00 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info is being set with open permissions: ugo+rw Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:00 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info Sep 29 12:37:00 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:00 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6" released by "delete_volume" :: held 1.009s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:37:00 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:37:00 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.info" returned: 0 in 0.480s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Created reservations ['191541b1-9235-4202-9c81-d650e88b6d64', '67e8e362-5d6a-4c77-8b2e-c8ca32d3a2db', '6b57be36-6a4c-4dbb-8e54-045accef5549', 'bbd57a94-cf1d-4704-a4b6-a870cf8b9246'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c2de4266-0f9c-4e8a-8199-2a7bb3d6868c tempest-SnapshotMetadataTestJSON-16756271 None] Create snapshot completed successfully Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68edf95-63b6-4593-a8b0-ccc9a2f6aef4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:01 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:01 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:01 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD Sep 29 12:37:01 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:01 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:01 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Deleted volume successfully. Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 is fetched for user 6865fcffcf9f48b9800b4eea7716d0e6. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-791a2219-b277-4ea5-ab88-5ef3ffe4e765 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-13b535b4-17d2-4b00-b55a-2c24a3d4bbc6-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[195518fa-7ce1-4fdc-aff2-0bb9cd9b6a16]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:01 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD Sep 29 12:37:01 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:01 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988255367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013cf800-f12f-4845-80ad-7a9c9a5483f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb2bce7abc64f0d83585eccdbc7e686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:00Z,use_quota=True,user_id='6865fcffcf9f48b9800b4eea7716d0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Creating volume 013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:01 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1073741824 Sep 29 12:37:01 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "cinder-ee967f04-b7c8-4fdd-9748-33ac071864d4-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-506ab3d6-742d-4679-acf3-2dcfb398fd9e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-ee967f04-b7c8-4fdd-9748-33ac071864d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-506ab3d6-742d-4679-acf3-2dcfb398fd9e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "cinder-quobyte-ee967f04-b7c8-4fdd-9748-33ac071864d4" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-quobyte-506ab3d6-742d-4679-acf3-2dcfb398fd9e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-ee967f04-b7c8-4fdd-9748-33ac071864d4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Deleting offline snapshot ee967f04-b7c8-4fdd-9748-33ac071864d4 of volume 8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] snapshot_file for this snap is: volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-506ab3d6-742d-4679-acf3-2dcfb398fd9e" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6cdb36-90a2-487f-81c4-6ae4e37dc60a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c30b1bf-bcef-4018-9d92-a4f7ab6f88ee]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 Sep 29 12:37:02 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:02 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e Sep 29 12:37:02 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:02 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1073741824" returned: 0 in 0.666s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 Sep 29 12:37:02 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:02 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[95368e61-2ba5-4464-bcc9-9e62af289460]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:02 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9" returned: 0 in 0.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:02 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e Sep 29 12:37:02 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Attempting download of 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 013cf800-f12f-4845-80ad-7a9c9a5483f9. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0699e266-f4cf-4139-a7a2-0e89711141f8]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:02 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa Sep 29 12:37:02 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z Sep 29 12:37:03 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-506ab3d6-742d-4679-acf3-2dcfb398fd9e" returned: 0 in 0.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-506ab3d6-742d-4679-acf3-2dcfb398fd9e" released by "delete_volume" :: held 0.763s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Created reservations ['377e90a5-b622-4286-b149-7c43f3c12b97', '126f2cd1-c965-4f38-905d-3618539fe66f', '1c0bc970-d4cb-474f-a801-c24c031d8594', '96cdeec0-6a38-47a2-8fa9-568cc35f6e46'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa" returned: 0 in 0.455s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:03 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 Sep 29 12:37:03 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z" returned: 0 in 0.398s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-1e2d6bae-b960-4f4b-9712-b89c565604d7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "cinder-1e2d6bae-b960-4f4b-9712-b89c565604d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:03 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z Sep 29 12:37:03 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Acquiring lock "cinder-quobyte-1e2d6bae-b960-4f4b-9712-b89c565604d7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-1e2d6bae-b960-4f4b-9712-b89c565604d7" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c19b3f-937a-405c-91df-11db12fba3e6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.306s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Deleted volume successfully. Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-967a8dc8-3df8-46db-b3c7-4289968a7426 tempest-VolumesTestJSON-1292254296 None] Lock "cinder-506ab3d6-742d-4679-acf3-2dcfb398fd9e-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:03 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 Sep 29 12:37:03 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4" returned: 0 in 0.494s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z" returned: 1 in 0.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_vyxhnc3z' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e75b90b-98ed-44b7-b79e-75677ee4a459]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:03 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4 Sep 29 12:37:03 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD Sep 29 12:37:03 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:03 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7" returned: 0 in 0.422s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:04 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7 Sep 29 12:37:04 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:04 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa.ee967f04-b7c8-4fdd-9748-33ac071864d4" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-ee967f04-b7c8-4fdd-9748-33ac071864d4" released by "_delete_snapshot" :: held 1.775s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" released by "delete_snapshot" :: held 1.817s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:04 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] 94feb733-57cd-4052-a12a-6ab2ace34da5 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Created reservations ['708d35b3-08a7-46ec-89c2-2e123c802d22', '1f2602b0-12a9-4760-9a0b-5ba6a77b3001', 'bf839011-0610-42cf-a14c-54d5638cdbc1', '286a690c-c6e9-439d-bb03-9d8de13f7f63'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:04 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 Sep 29 12:37:04 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Delete snapshot completed successfully. Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-43afdfa8-d7d3-4d39-8cfd-d18345773f97 tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-ee967f04-b7c8-4fdd-9748-33ac071864d4-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:04 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2d6bae-b960-4f4b-9712-b89c565604d7" returned: 0 in 0.296s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "cinder-quobyte-1e2d6bae-b960-4f4b-9712-b89c565604d7" released by "delete_volume" :: held 0.771s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Created reservations ['b003d3b8-7908-4899-863b-ac9ef94d309b', '4e458541-f5a2-479a-8079-2804576a91f9', 'a242d95c-373a-4c08-98e1-03d3cf9dccd4', '961354d4-4ec6-4091-a563-50dcaf0ae3f1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "cinder-8924b1b0-07fe-4512-9506-6de2aa8e89fa-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:04 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:04 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-8924b1b0-07fe-4512-9506-6de2aa8e89fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf21e5d2-64be-4973-ae68-101d32fd2492]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:04 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa Sep 29 12:37:04 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:04 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.352s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Deleted volume successfully. Sep 29 12:37:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e255d38f-ff14-4641-b694-f2e640c3537a tempest-VolumesTestJSON-1292254296 None] Lock "cinder-1e2d6bae-b960-4f4b-9712-b89c565604d7-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:05 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa" returned: 0 in 0.460s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:05 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa Sep 29 12:37:05 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:05 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8924b1b0-07fe-4512-9506-6de2aa8e89fa" returned: 0 in 0.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-quobyte-8924b1b0-07fe-4512-9506-6de2aa8e89fa" released by "delete_volume" :: held 0.853s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Created reservations ['65ed9f6c-d430-4bef-97e9-b8ea752d630b', 'b0ec4560-ef82-4ceb-b312-9787523af0ad', '29f0cc91-d19e-4fac-a96d-99710543c672', '48369b6d-27b7-47ba-aaa4-697d1ba166c4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:05 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:05 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:06 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.407s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Deleted volume successfully. Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec245db8-9b89-4d11-9bdc-0d7ee39b4b8e tempest-SnapshotMetadataTestJSON-16756271 None] Lock "cinder-8924b1b0-07fe-4512-9506-6de2aa8e89fa-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:06 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9" returned: 0 in 2.537s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_irv2xgwydevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:37:06 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Converted 112.00 MB image at 44.13 MB/s Sep 29 12:37:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:06 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1G Sep 29 12:37:06 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:07 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 1G" returned: 0 in 0.464s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Downloaded image 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 013cf800-f12f-4845-80ad-7a9c9a5483f9 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 for user 6865fcffcf9f48b9800b4eea7716d0e6 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Marking volume 013cf800-f12f-4845-80ad-7a9c9a5483f9 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Copying metadata from image 94feb733-57cd-4052-a12a-6ab2ace34da5 to 013cf800-f12f-4845-80ad-7a9c9a5483f9. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Creating volume glance metadata for volume 013cf800-f12f-4845-80ad-7a9c9a5483f9 backed by image 94feb733-57cd-4052-a12a-6ab2ace34da5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ae3a9-1a95-41e0-b5ae-6e95f869b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013cf800-f12f-4845-80ad-7a9c9a5483f9', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a35a1-f4fd-4cea-a829-13343cd59571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Volume volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 (013cf800-f12f-4845-80ad-7a9c9a5483f9): created successfully Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a35a1-f4fd-4cea-a829-13343cd59571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Flow 'volume_create_manager' (ba2bcee2-e447-488a-aaf6-e1f6731db2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1c5065f-d1a1-4cd5-bedb-4c5c8664b96b tempest-ServerActionsTestOtherA-1845306863 None] Created volume successfully. Sep 29 12:37:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-439c4e96-3271-45db-827f-ed60373bc3bd tempest-GroupsTest-855812939 None] Group tempest-Group1-1943828102: creating Sep 29 12:37:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-439c4e96-3271-45db-827f-ed60373bc3bd tempest-GroupsTest-855812939 None] Group tempest-Group1-1943828102: created successfully Sep 29 12:37:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-439c4e96-3271-45db-827f-ed60373bc3bd tempest-GroupsTest-855812939 None] Create group completed successfully. Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Flow 'volume_create_manager' (86f80a53-d992-47c5-9c13-6ef970b401cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d519ae5a-b744-4fc3-b97c-4310f5656969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d519ae5a-b744-4fc3-b97c-4310f5656969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-472082491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571d7049-2823-4e46-997b-1837a96c533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b53ec6db814c4ca7671c7ad749ea80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:12Z,use_quota=True,user_id='54d30d4b4eb8443e8b9c0a8eb1f9953a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3748e2-c515-440e-a52b-0bfeecd3329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3748e2-c515-440e-a52b-0bfeecd3329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00b9995-0b02-424c-87e3-8ec9d83067b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00b9995-0b02-424c-87e3-8ec9d83067b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571d7049-2823-4e46-997b-1837a96c533e', 'volume_name': 'volume-571d7049-2823-4e46-997b-1837a96c533e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8a43c1-2544-4b97-a1e6-36583168f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8a43c1-2544-4b97-a1e6-36583168f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd7e99e-db22-46ca-9a27-f86a5e588b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Volume 571d7049-2823-4e46-997b-1837a96c533e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571d7049-2823-4e46-997b-1837a96c533e', 'volume_size': 1} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-472082491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571d7049-2823-4e46-997b-1837a96c533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b53ec6db814c4ca7671c7ad749ea80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:12Z,use_quota=True,user_id='54d30d4b4eb8443e8b9c0a8eb1f9953a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Creating volume 571d7049-2823-4e46-997b-1837a96c533e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:11 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e 1073741824 Sep 29 12:37:11 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0e93206-1e27-4878-b751-67503d870f0f tempest-GroupsTest-855812939 None] Group tempest-Group2-438193667: creating Sep 29 12:37:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0e93206-1e27-4878-b751-67503d870f0f tempest-GroupsTest-855812939 None] Group tempest-Group2-438193667: created successfully Sep 29 12:37:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0e93206-1e27-4878-b751-67503d870f0f tempest-GroupsTest-855812939 None] Create group completed successfully. Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0594d190-ce7c-4915-9b5f-1de4abc4327b req-60c8113a-bee5-4c63-bc74-3e7446ac3e3a tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:12 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e 1073741824" returned: 0 in 0.674s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:12 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e Sep 29 12:37:12 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:12 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e" returned: 0 in 0.287s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0594d190-ce7c-4915-9b5f-1de4abc4327b req-60c8113a-bee5-4c63-bc74-3e7446ac3e3a tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.787s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd7e99e-db22-46ca-9a27-f86a5e588b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571d7049-2823-4e46-997b-1837a96c533e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b586bea2-4dff-4a53-ac10-bee716737d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0594d190-ce7c-4915-9b5f-1de4abc4327b req-60c8113a-bee5-4c63-bc74-3e7446ac3e3a tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Volume volume-571d7049-2823-4e46-997b-1837a96c533e (571d7049-2823-4e46-997b-1837a96c533e): created successfully Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b586bea2-4dff-4a53-ac10-bee716737d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Flow 'volume_create_manager' (86f80a53-d992-47c5-9c13-6ef970b401cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4a2ebdf3-d71a-4146-ac4b-70eeb90e2853 tempest-AbsoluteLimitsTests-672292721 None] Created volume successfully. Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-0594d190-ce7c-4915-9b5f-1de4abc4327b req-60c8113a-bee5-4c63-bc74-3e7446ac3e3a tempest-ServerActionsTestOtherA-1845306863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-013cf800-f12f-4845-80ad-7a9c9a5483f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0b0db19-1c12-480f-b71a-78d5ffb32f11', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:37:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-0594d190-ce7c-4915-9b5f-1de4abc4327b req-60c8113a-bee5-4c63-bc74-3e7446ac3e3a tempest-ServerActionsTestOtherA-1845306863 None] attachment_update completed successfully. Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (597b107c-9b20-4ec5-8fc5-d7f95fb03e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8075f573-5509-4d8c-a0a9-2700237ac741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8075f573-5509-4d8c-a0a9-2700237ac741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1750465876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a97fde2-fb58-4a69-905e-eff3ac233cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:13Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b00c586-db8c-4eea-929d-9129b8bd9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b00c586-db8c-4eea-929d-9129b8bd9854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6248afb3-ef4d-4c09-949e-ae16cefbd2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6248afb3-ef4d-4c09-949e-ae16cefbd2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a97fde2-fb58-4a69-905e-eff3ac233cea', 'volume_name': 'volume-5a97fde2-fb58-4a69-905e-eff3ac233cea', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84764a5-a286-4e25-bd42-93f38da8c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84764a5-a286-4e25-bd42-93f38da8c805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a66af97-694d-4f9a-9102-5fad4031b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Volume 5a97fde2-fb58-4a69-905e-eff3ac233cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a97fde2-fb58-4a69-905e-eff3ac233cea', 'volume_size': 1} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1750465876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a97fde2-fb58-4a69-905e-eff3ac233cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f356a38d244029ad1af479205a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:13Z,use_quota=True,user_id='6a0f2a8836944cc4ade4bcd54e4bf6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Creating volume 5a97fde2-fb58-4a69-905e-eff3ac233cea {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:13 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:13 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea 1073741824 Sep 29 12:37:13 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Acquiring lock "cinder-571d7049-2823-4e46-997b-1837a96c533e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "cinder-571d7049-2823-4e46-997b-1837a96c533e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Acquiring lock "cinder-quobyte-571d7049-2823-4e46-997b-1837a96c533e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "cinder-quobyte-571d7049-2823-4e46-997b-1837a96c533e" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eee15a-0695-46b1-a193-85937f5b6297]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (a2eaf682-cc21-44f9-b09c-803f2282bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6450fbc4-0b63-4a97-9de5-739a25c9f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6450fbc4-0b63-4a97-9de5-739a25c9f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2087060860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5fb1112-4f55-428d-9954-2775df9d8162,host='devstack@QuobyteHD#QuobyteHD',id=8c8e188d-d027-4c14-9658-77df2cadc4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:14Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff5b162-6012-4777-97b8-988dd6891f42),volume_type_id=2ff5b162-6012-4777-97b8-988dd6891f42)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e Sep 29 12:37:14 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bed170-1d6f-4ad4-b931-529e1dd78834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bed170-1d6f-4ad4-b931-529e1dd78834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c95518-0a38-4df9-aca1-f2769034139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c95518-0a38-4df9-aca1-f2769034139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8e188d-d027-4c14-9658-77df2cadc4da', 'volume_name': 'volume-8c8e188d-d027-4c14-9658-77df2cadc4da', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a98e38-9784-4173-a34f-a984c0cc5302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a98e38-9784-4173-a34f-a984c0cc5302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78fa33-d271-4d30-90dc-e886b673ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Volume 8c8e188d-d027-4c14-9658-77df2cadc4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8e188d-d027-4c14-9658-77df2cadc4da', 'volume_size': 1} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea 1073741824" returned: 0 in 0.703s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:14 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea Sep 29 12:37:14 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:14 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e" returned: 0 in 0.513s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:14 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e Sep 29 12:37:14 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:14 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5fb1112-4f55-428d-9954-2775df9d8162,created_at=2026-09-29T10:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2087060860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5fb1112-4f55-428d-9954-2775df9d8162,host='devstack@QuobyteHD#QuobyteHD',id=8c8e188d-d027-4c14-9658-77df2cadc4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:14Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff5b162-6012-4777-97b8-988dd6891f42),volume_type_id=2ff5b162-6012-4777-97b8-988dd6891f42)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Creating volume 8c8e188d-d027-4c14-9658-77df2cadc4da {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:14 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:14 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da 1073741824 Sep 29 12:37:14 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a66af97-694d-4f9a-9102-5fad4031b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a97fde2-fb58-4a69-905e-eff3ac233cea', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fa876a-3180-4b87-b722-c4ff73de67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Volume volume-5a97fde2-fb58-4a69-905e-eff3ac233cea (5a97fde2-fb58-4a69-905e-eff3ac233cea): created successfully Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fa876a-3180-4b87-b722-c4ff73de67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Flow 'volume_create_manager' (597b107c-9b20-4ec5-8fc5-d7f95fb03e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6ca5cba2-2445-4de7-bb28-fbdac5758701 tempest-AttachVolumeNegativeTest-1839513264 None] Created volume successfully. Sep 29 12:37:15 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-571d7049-2823-4e46-997b-1837a96c533e" returned: 0 in 0.300s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "cinder-quobyte-571d7049-2823-4e46-997b-1837a96c533e" released by "delete_volume" :: held 0.876s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Created reservations ['94fe368c-24a1-4330-876c-396b10a4cf70', '5622b12e-114e-411d-9879-e4945b1cae63', '6d5f847d-0948-4790-9457-d0301f0b3375', 'dd987d43-34ed-4631-b49b-55f42e02bb57'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:15 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:15 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:15 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da 1073741824" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:15 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da Sep 29 12:37:15 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:15 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.725s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Deleted volume successfully. Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-94661d6a-b899-4d31-bf96-0f07c6220368 tempest-AbsoluteLimitsTests-672292721 None] Lock "cinder-571d7049-2823-4e46-997b-1837a96c533e-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:16 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da" returned: 0 in 0.639s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78fa33-d271-4d30-90dc-e886b673ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8e188d-d027-4c14-9658-77df2cadc4da', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445c2f1b-6e9a-4bd4-b35d-d040219e77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Volume volume-8c8e188d-d027-4c14-9658-77df2cadc4da (8c8e188d-d027-4c14-9658-77df2cadc4da): created successfully Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445c2f1b-6e9a-4bd4-b35d-d040219e77c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (a2eaf682-cc21-44f9-b09c-803f2282bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2ebb25fd-58d6-44f4-9c82-14296957cd83 tempest-GroupsTest-855812939 None] Created volume successfully. Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3bfb87ff-aaa9-4b01-a06c-f42640caae54 req-f7e7f1c6-6cf7-47de-b119-ee0f3a4ae651 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3bfb87ff-aaa9-4b01-a06c-f42640caae54 req-f7e7f1c6-6cf7-47de-b119-ee0f3a4ae651 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-3bfb87ff-aaa9-4b01-a06c-f42640caae54 req-f7e7f1c6-6cf7-47de-b119-ee0f3a4ae651 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-3bfb87ff-aaa9-4b01-a06c-f42640caae54 req-f7e7f1c6-6cf7-47de-b119-ee0f3a4ae651 tempest-AttachVolumeNegativeTest-1839513264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-5a97fde2-fb58-4a69-905e-eff3ac233cea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2c3a83a-961b-4d57-a426-1352f8e1ea33', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:37:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-3bfb87ff-aaa9-4b01-a06c-f42640caae54 req-f7e7f1c6-6cf7-47de-b119-ee0f3a4ae651 tempest-AttachVolumeNegativeTest-1839513264 None] attachment_update completed successfully. Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Acquiring lock "cinder-quobyte-8c8e188d-d027-4c14-9658-77df2cadc4da" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-8c8e188d-d027-4c14-9658-77df2cadc4da" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b84b6-b6b5-4f75-9e51-9bdc5b2467e7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:17 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da Sep 29 12:37:17 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:18 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da" returned: 0 in 0.644s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:18 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da Sep 29 12:37:18 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:18 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8e188d-d027-4c14-9658-77df2cadc4da" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-8c8e188d-d027-4c14-9658-77df2cadc4da" released by "delete_volume" :: held 1.095s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Created reservations ['1ee9fc54-0e2a-4731-aad3-6ef07bcde079'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:18 devstack cinder-volume[86763]: WARNING cinder.quota [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-603313318 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-603313318, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:37:18 devstack cinder-volume[86763]: WARNING cinder.quota [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-603313318 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-603313318, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:37:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Created reservations ['72868f05-5b14-4b9b-b5ba-d86dd5238d88', 'fa44b723-5f63-4c7c-b00d-33e1237875ed', '40de7b30-c292-4845-b660-d0972740830f', 'e1bfad71-485a-4a1f-a6d1-aab843920d9a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:19 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:19 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:19 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.435s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e86a52ff-714f-4214-afe8-388edd606465 tempest-GroupsTest-855812939 None] Delete group completed successfully. Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Created reservations ['58671dd5-6ece-426c-9ebd-124d0522a208'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:20 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:20 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:20 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-76083c56-2e44-40ba-b36c-322cfe184660 tempest-GroupsTest-855812939 None] Delete group completed successfully. Sep 29 12:37:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-4ec70077-3932-43b0-99c3-47cddc85ba6f req-6683a47a-e15a-4f21-b47a-89c7cf4c10da tempest-AttachVolumeNegativeTest-1839513264 None] Terminate volume connection completed successfully. Sep 29 12:37:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4ec70077-3932-43b0-99c3-47cddc85ba6f req-6683a47a-e15a-4f21-b47a-89c7cf4c10da tempest-AttachVolumeNegativeTest-1839513264 None] Deleting attachment f2c3a83a-961b-4d57-a426-1352f8e1ea33. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:37:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2c5d198e-8b40-4c38-ae59-d8eeb9ae0e06 tempest-GroupsTest-855812939 None] Group tempest-GroupsTest-Group-1890224618: creating Sep 29 12:37:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2c5d198e-8b40-4c38-ae59-d8eeb9ae0e06 tempest-GroupsTest-855812939 None] Group tempest-GroupsTest-Group-1890224618: created successfully Sep 29 12:37:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2c5d198e-8b40-4c38-ae59-d8eeb9ae0e06 tempest-GroupsTest-855812939 None] Create group completed successfully. Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (46982980-eaf1-40e5-99d7-ab3746e0fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88eed477-69b2-4912-bbd4-45ce02ea2b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88eed477-69b2-4912-bbd4-45ce02ea2b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546420308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,host='devstack@QuobyteHD#QuobyteHD',id=00a89004-68af-4cc8-85be-3de78471d7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:25Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c8ac6c-ce0e-4e16-8755-9b60534d1506),volume_type_id=d2c8ac6c-ce0e-4e16-8755-9b60534d1506)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf553f-0ac1-4f95-8046-4502c29a0bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf553f-0ac1-4f95-8046-4502c29a0bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f03bde5-5697-4ef5-b76e-f10a49afdf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f03bde5-5697-4ef5-b76e-f10a49afdf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a89004-68af-4cc8-85be-3de78471d7ce', 'volume_name': 'volume-00a89004-68af-4cc8-85be-3de78471d7ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036e4853-7fb4-4d5a-98a2-7fa8f768f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036e4853-7fb4-4d5a-98a2-7fa8f768f493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdc66f4-8ff7-4f44-b6e8-adcc302fc59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Volume 00a89004-68af-4cc8-85be-3de78471d7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a89004-68af-4cc8-85be-3de78471d7ce', 'volume_size': 1} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,created_at=2026-09-29T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546420308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,host='devstack@QuobyteHD#QuobyteHD',id=00a89004-68af-4cc8-85be-3de78471d7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:25Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c8ac6c-ce0e-4e16-8755-9b60534d1506),volume_type_id=d2c8ac6c-ce0e-4e16-8755-9b60534d1506)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Creating volume 00a89004-68af-4cc8-85be-3de78471d7ce {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:25 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce 1073741824 Sep 29 12:37:25 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Flow 'volume_create_manager' (b7c676d9-c069-4863-9665-9bb18d232bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e98d8-a6bd-4336-9459-82968a3386e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e98d8-a6bd-4336-9459-82968a3386e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2142024032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814e6bcd-8a0f-4b11-b662-aac28f488e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46eab67164a5418bb16384efc4b816e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:26Z,use_quota=True,user_id='462d7385117a4e079e2c14a4849c4d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98bef90-3f1f-48cf-b997-03f9b6287b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98bef90-3f1f-48cf-b997-03f9b6287b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e29cee-295d-4374-ae88-e554c2c1a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e29cee-295d-4374-ae88-e554c2c1a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814e6bcd-8a0f-4b11-b662-aac28f488e2c', 'volume_name': 'volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc66d13-2457-4349-ba1a-55ac1ec39cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc66d13-2457-4349-ba1a-55ac1ec39cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0409ff-b6b3-439f-8c5e-7ad73d74a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Volume 814e6bcd-8a0f-4b11-b662-aac28f488e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c', 'volume_size': 1} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:26 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce 1073741824" returned: 0 in 0.669s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:26 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce Sep 29 12:37:26 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:26 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce" returned: 0 in 0.281s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2142024032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814e6bcd-8a0f-4b11-b662-aac28f488e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46eab67164a5418bb16384efc4b816e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:26Z,use_quota=True,user_id='462d7385117a4e079e2c14a4849c4d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Creating volume 814e6bcd-8a0f-4b11-b662-aac28f488e2c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdc66f4-8ff7-4f44-b6e8-adcc302fc59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a89004-68af-4cc8-85be-3de78471d7ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c 1073741824 Sep 29 12:37:26 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5f99eb-d217-4a36-b3bc-5d72ff6c9e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Volume volume-00a89004-68af-4cc8-85be-3de78471d7ce (00a89004-68af-4cc8-85be-3de78471d7ce): created successfully Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5f99eb-d217-4a36-b3bc-5d72ff6c9e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (46982980-eaf1-40e5-99d7-ab3746e0fc95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b21c63ac-efbe-4cbf-b3b1-267d74c8bd91 tempest-GroupsTest-855812939 None] Created volume successfully. Sep 29 12:37:27 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c 1073741824" returned: 0 in 0.874s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:27 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c Sep 29 12:37:27 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:28 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c" returned: 0 in 0.568s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0409ff-b6b3-439f-8c5e-7ad73d74a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf2cda1-8915-4b1f-8284-9255ee6effc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (8bf80ed3-1836-453c-b559-9aa1b26ea822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c51e54c-28b5-41c9-901b-f2c0c3c3a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Volume volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c (814e6bcd-8a0f-4b11-b662-aac28f488e2c): created successfully Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf2cda1-8915-4b1f-8284-9255ee6effc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Flow 'volume_create_manager' (b7c676d9-c069-4863-9665-9bb18d232bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c51e54c-28b5-41c9-901b-f2c0c3c3a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745787992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,host='devstack@QuobyteHD#QuobyteHD',id=f3502a76-b652-4b0e-8e03-54d1ab03e328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:28Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c8ac6c-ce0e-4e16-8755-9b60534d1506),volume_type_id=d2c8ac6c-ce0e-4e16-8755-9b60534d1506)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0c26a2-c16f-43b6-8d30-c8d53db7f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0c26a2-c16f-43b6-8d30-c8d53db7f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabdcee9-3d2c-4b6c-aa28-ea7ef49d53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabdcee9-3d2c-4b6c-aa28-ea7ef49d53ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3502a76-b652-4b0e-8e03-54d1ab03e328', 'volume_name': 'volume-f3502a76-b652-4b0e-8e03-54d1ab03e328', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab385875-8110-4a09-928a-00b4cb9768db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab385875-8110-4a09-928a-00b4cb9768db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9096094e-8108-4d0e-b084-017de9b41a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Volume f3502a76-b652-4b0e-8e03-54d1ab03e328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3502a76-b652-4b0e-8e03-54d1ab03e328', 'volume_size': 1} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,created_at=2026-09-29T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745787992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e664750a-cea1-47f3-9fe7-bdbb5ef5d798,host='devstack@QuobyteHD#QuobyteHD',id=f3502a76-b652-4b0e-8e03-54d1ab03e328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3fdda34b8f4c07a88dba8502f2dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:28Z,use_quota=True,user_id='b4c5115549ac44008d7d6d3f41673131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c8ac6c-ce0e-4e16-8755-9b60534d1506),volume_type_id=d2c8ac6c-ce0e-4e16-8755-9b60534d1506)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Creating volume f3502a76-b652-4b0e-8e03-54d1ab03e328 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-62a144c3-b162-490c-84e0-39c317ed9a87 tempest-VolumesMetadataTest-239249628 None] Created volume successfully. Sep 29 12:37:28 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 1073741824 Sep 29 12:37:28 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:29 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 1073741824" returned: 0 in 0.701s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-5a97fde2-fb58-4a69-905e-eff3ac233cea-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-5a97fde2-fb58-4a69-905e-eff3ac233cea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:29 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 Sep 29 12:37:29 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-quobyte-5a97fde2-fb58-4a69-905e-eff3ac233cea" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-5a97fde2-fb58-4a69-905e-eff3ac233cea" acquired by "delete_volume" :: waited 0.061s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214cd2c-6ed5-4c86-bb4b-0c73c6e3a837]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:29 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea Sep 29 12:37:29 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:30 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328" returned: 0 in 0.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9096094e-8108-4d0e-b084-017de9b41a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3502a76-b652-4b0e-8e03-54d1ab03e328', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d503d95d-101c-4001-b55f-d873674944e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:30 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea" returned: 0 in 0.615s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:30 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea Sep 29 12:37:30 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Volume volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 (f3502a76-b652-4b0e-8e03-54d1ab03e328): created successfully Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d503d95d-101c-4001-b55f-d873674944e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Flow 'volume_create_manager' (8bf80ed3-1836-453c-b559-9aa1b26ea822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:30 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:30 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-38dea2a0-a71f-45cf-8e0f-3fea3e7f548b tempest-GroupsTest-855812939 None] Created volume successfully. Sep 29 12:37:30 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a97fde2-fb58-4a69-905e-eff3ac233cea" returned: 0 in 0.578s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:30 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-5a97fde2-fb58-4a69-905e-eff3ac233cea" released by "delete_volume" :: held 1.337s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.583s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:37:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Created reservations ['8c1ed517-76f5-4dbc-b16a-d32b54c9e82e', '8af08bb1-4bef-455a-b856-353dbbe68239', 'b52227bd-257a-48e9-8864-31f82f9733c8', 'e903c0b3-8495-4862-975c-22f77a74b797'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Acquiring lock "cinder-814e6bcd-8a0f-4b11-b662-aac28f488e2c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "cinder-814e6bcd-8a0f-4b11-b662-aac28f488e2c-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:31 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:31 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Acquiring lock "cinder-quobyte-814e6bcd-8a0f-4b11-b662-aac28f488e2c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "cinder-quobyte-814e6bcd-8a0f-4b11-b662-aac28f488e2c" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a78426-012e-428d-8f4b-e214851f7b7a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d3bf06e0-814d-48bc-8950-e2d00f0a4a23 tempest-GroupsTest-855812939 None] Update group completed successfully. Sep 29 12:37:31 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c Sep 29 12:37:31 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:31 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.619s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Deleted volume successfully. Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2646fdd-04d7-4989-87bf-93d383f29499 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-5a97fde2-fb58-4a69-905e-eff3ac233cea-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-7e430b94-cc76-463e-a61c-59c0edb2d55f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-7e430b94-cc76-463e-a61c-59c0edb2d55f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-quobyte-7e430b94-cc76-463e-a61c-59c0edb2d55f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-7e430b94-cc76-463e-a61c-59c0edb2d55f" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f822a013-a065-4fa0-bcdd-ce0dfaa02055]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:32 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c" returned: 0 in 0.807s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:32 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c Sep 29 12:37:32 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:32 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f Sep 29 12:37:32 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:32 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-814e6bcd-8a0f-4b11-b662-aac28f488e2c" returned: 0 in 0.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "cinder-quobyte-814e6bcd-8a0f-4b11-b662-aac28f488e2c" released by "delete_volume" :: held 1.224s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Created reservations ['2ac9682a-63be-4e1f-b23a-0b8a9415d9b4', '5927be83-7802-47ea-9291-5b1ccccfbbc3', '1577e19a-cc06-4233-8d82-dca569de3303', '1f284b58-e056-4961-8a25-6915d877cd01'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:33 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:33 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:33 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f" returned: 0 in 0.888s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:33 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f Sep 29 12:37:33 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f6b5fefb-bcd5-43f7-8707-ef01c117629f tempest-GroupsTest-855812939 None] Update group completed successfully. Sep 29 12:37:33 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Deleted volume successfully. Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c94b3af-121c-4903-9751-ab9fae86eec8 tempest-VolumesMetadataTest-239249628 None] Lock "cinder-814e6bcd-8a0f-4b11-b662-aac28f488e2c-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:33 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7e430b94-cc76-463e-a61c-59c0edb2d55f" returned: 0 in 0.444s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-7e430b94-cc76-463e-a61c-59c0edb2d55f" released by "delete_volume" :: held 1.382s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Created reservations ['51d4100e-5388-42b7-aba3-66c475438095', '987d587a-599f-41b0-83be-54baf86e6b07', '10f0c6c9-00db-4180-876b-25560f01d24e', '5d591120-0c51-4d0f-a65c-36c7cfba033e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:33 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:33 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:34 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.358s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Deleted volume successfully. Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5976abfd-7b64-4fad-afcc-a40cfd8fa408 tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-7e430b94-cc76-463e-a61c-59c0edb2d55f-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-00fa9948-aff0-40e5-9c81-ccc378ae019e tempest-ServerActionsTestOtherA-1845306863 None] Terminate volume connection completed successfully. Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-00fa9948-aff0-40e5-9c81-ccc378ae019e tempest-ServerActionsTestOtherA-1845306863 None] Deleting attachment c0b0db19-1c12-480f-b71a-78d5ffb32f11. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-eaac7151-a4ee-446a-bac5-d87577dd8d19-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-eaac7151-a4ee-446a-bac5-d87577dd8d19-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "cinder-quobyte-eaac7151-a4ee-446a-bac5-d87577dd8d19" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-eaac7151-a4ee-446a-bac5-d87577dd8d19" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a353c7-0062-4535-b888-b2daae86bab2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:35 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 Sep 29 12:37:35 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Acquiring lock "cinder-quobyte-00a89004-68af-4cc8-85be-3de78471d7ce" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-00a89004-68af-4cc8-85be-3de78471d7ce" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ff273-72e5-426c-b4b3-0e208c53a4d2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:35 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce Sep 29 12:37:35 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:35 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19" returned: 0 in 0.580s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:35 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19 Sep 29 12:37:35 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:35 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce" returned: 0 in 0.540s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:35 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce Sep 29 12:37:35 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:35 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eaac7151-a4ee-446a-bac5-d87577dd8d19" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-quobyte-eaac7151-a4ee-446a-bac5-d87577dd8d19" released by "delete_volume" :: held 0.960s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Created reservations ['8d4eb96e-8f2f-48d1-b19c-6b92db89c546', 'e2e806c2-1a53-477a-aa27-3b0f883abc09', 'b6acd1eb-135e-4bcd-a6ee-727dcfdc3ae7', '5ba9e6f6-da79-437f-bf5d-aa7caf19aefd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:36 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:36 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:36 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-00a89004-68af-4cc8-85be-3de78471d7ce" returned: 0 in 0.310s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-00a89004-68af-4cc8-85be-3de78471d7ce" released by "delete_volume" :: held 0.920s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Acquiring lock "cinder-quobyte-f3502a76-b652-4b0e-8e03-54d1ab03e328" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-f3502a76-b652-4b0e-8e03-54d1ab03e328" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c56d3-401c-4a5b-9ea1-d2b63d5c1cda]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:36 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 Sep 29 12:37:36 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:36 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.296s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Deleted volume successfully. Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6d24f862-9aef-41fd-ae38-43d87297399a tempest-AttachVolumeNegativeTest-1839513264 None] Lock "cinder-eaac7151-a4ee-446a-bac5-d87577dd8d19-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-fca6aa64-cca4-485d-8933-74c9f09a17eb tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-fca6aa64-cca4-485d-8933-74c9f09a17eb tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:36 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-fca6aa64-cca4-485d-8933-74c9f09a17eb tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328" returned: 0 in 0.478s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:36 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328 Sep 29 12:37:36 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-fca6aa64-cca4-485d-8933-74c9f09a17eb tempest-ServerActionsTestOtherA-1845306863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-013cf800-f12f-4845-80ad-7a9c9a5483f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cc2489f-4e11-43cb-baea-3553ef4a0143', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:37:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-aa5d560e-9e90-48dd-b474-427795d9e926 req-fca6aa64-cca4-485d-8933-74c9f09a17eb tempest-ServerActionsTestOtherA-1845306863 None] attachment_update completed successfully. Sep 29 12:37:37 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f3502a76-b652-4b0e-8e03-54d1ab03e328" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "cinder-quobyte-f3502a76-b652-4b0e-8e03-54d1ab03e328" released by "delete_volume" :: held 0.941s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Created reservations ['14775b1d-d917-4b81-9f36-0b1109655939'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:37 devstack cinder-volume[86763]: WARNING cinder.quota [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-462167279 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-462167279, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:37:37 devstack cinder-volume[86763]: WARNING cinder.quota [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-462167279 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-462167279, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Created reservations ['7cdc43c6-2fee-43a5-ac1f-e0968e5007d3', '2858d9b7-8440-43db-b928-dc9cab8e49ff', 'ecc04d4f-4e46-40a7-9c08-2d044d275064', '5350f1f1-a564-43e5-b647-67f4c9d19461'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Created reservations ['72e32716-95ea-40c1-81cf-af221dd7b4d9', 'a79a67a5-e87b-4769-ac9b-546312532ba4', 'b0807775-eaf9-4680-a610-6eca3bd460e1', 'dcbbe37c-2d58-46f8-a903-3ff385166a77'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:37 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:37 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:38 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-992a5481-37d1-479c-913b-4895010381b8 tempest-GroupsTest-855812939 None] Delete group completed successfully. Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Flow 'volume_create_manager' (d3d9fca1-f7fb-4ea8-8b41-417a096a3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282277e3-1f3b-4191-91ce-5464fc1d278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282277e3-1f3b-4191-91ce-5464fc1d278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1124690024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83368e-eefe-4041-b4b8-5bd5eb27b58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d8d1e26ec445da9b9836944d539565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:42Z,use_quota=True,user_id='556c93a658484fc5837af2c162bd6f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675725c-615f-41ba-9d82-c6ef6fca1f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675725c-615f-41ba-9d82-c6ef6fca1f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66375b0e-4eec-4109-98f9-7ebc625b73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66375b0e-4eec-4109-98f9-7ebc625b73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc83368e-eefe-4041-b4b8-5bd5eb27b58d', 'volume_name': 'volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915d9c45-00be-411e-af9b-13c1f807b1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915d9c45-00be-411e-af9b-13c1f807b1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccde961-42bd-4508-802c-e0c8962ec9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Volume cc83368e-eefe-4041-b4b8-5bd5eb27b58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d', 'volume_size': 1} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1124690024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83368e-eefe-4041-b4b8-5bd5eb27b58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d8d1e26ec445da9b9836944d539565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:42Z,use_quota=True,user_id='556c93a658484fc5837af2c162bd6f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Creating volume cc83368e-eefe-4041-b4b8-5bd5eb27b58d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:42 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:42 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d 1073741824 Sep 29 12:37:42 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:42 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d 1073741824" returned: 0 in 0.702s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:43 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d Sep 29 12:37:43 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:43 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" returned: 0 in 0.467s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccde961-42bd-4508-802c-e0c8962ec9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e8d54b-b2d4-49f6-85d5-80e47a89fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Volume volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d (cc83368e-eefe-4041-b4b8-5bd5eb27b58d): created successfully Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e8d54b-b2d4-49f6-85d5-80e47a89fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Flow 'volume_create_manager' (d3d9fca1-f7fb-4ea8-8b41-417a096a3c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-392eda33-5001-4342-81c8-4b217fa0af3c tempest-VolumesTransfersV355Test-672444275 None] Created volume successfully. Sep 29 12:37:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0f0a62c6-eb1d-4881-a677-b72cedef4c3e tempest-VolumesTransfersV355Test-749824551 None] Transfer volume completed successfully. Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "cinder-cc83368e-eefe-4041-b4b8-5bd5eb27b58d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-cc83368e-eefe-4041-b4b8-5bd5eb27b58d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "cinder-quobyte-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-quobyte-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b6f25-9e72-4660-a47d-6316e4b2568f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:48 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d Sep 29 12:37:48 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:49 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" returned: 0 in 0.489s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:49 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d Sep 29 12:37:49 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:49 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" returned: 0 in 0.372s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-quobyte-cc83368e-eefe-4041-b4b8-5bd5eb27b58d" released by "delete_volume" :: held 0.975s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Created reservations ['fa793c6a-a6cb-4c4a-9be3-78148d1f7ca0', 'a03189de-8977-4ebf-8f55-5e9d067d6b9a', '6844bb53-d9a6-4fcd-b84d-b5284f718333', '2e282f24-6ce8-4ec1-822e-af05fa8060d5'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:49 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:49 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:50 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.417s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Deleted volume successfully. Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97a35a5a-a76b-4b5c-999f-1d6b1dbdc132 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-cc83368e-eefe-4041-b4b8-5bd5eb27b58d-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d916240d-07b3-45ab-a6f0-6efa2a5c07cb tempest-GroupsV314Test-999990677 None] Group tempest-GroupsV314Test-Group-930662487: creating Sep 29 12:37:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d916240d-07b3-45ab-a6f0-6efa2a5c07cb tempest-GroupsV314Test-999990677 None] Group tempest-GroupsV314Test-Group-930662487: created successfully Sep 29 12:37:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d916240d-07b3-45ab-a6f0-6efa2a5c07cb tempest-GroupsV314Test-999990677 None] Create group completed successfully. Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Flow 'volume_create_manager' (8766e973-8a5d-4e86-87d4-9d9c61ebb04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c70cb74-10e9-4557-9e8e-7b9e2467a224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c70cb74-10e9-4557-9e8e-7b9e2467a224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-262836071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9809e72-1847-4258-b04a-728cd0dcd89e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5df2e72bcf034ab89ec0a00463bc90a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:51Z,use_quota=True,user_id='ce90d333a311431ab48e54e2ac30c747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acd85b4-9b1d-4d05-b788-767bb0736ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acd85b4-9b1d-4d05-b788-767bb0736ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590dbc42-5e7d-4c10-8dbb-2906f3f56e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590dbc42-5e7d-4c10-8dbb-2906f3f56e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9809e72-1847-4258-b04a-728cd0dcd89e', 'volume_name': 'volume-a9809e72-1847-4258-b04a-728cd0dcd89e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9f611e-8463-41e0-a635-9922b5264833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9f611e-8463-41e0-a635-9922b5264833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df29f37-af6a-43ca-aa3a-5ffa57ed0a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Volume a9809e72-1847-4258-b04a-728cd0dcd89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9809e72-1847-4258-b04a-728cd0dcd89e', 'volume_size': 1} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-262836071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9809e72-1847-4258-b04a-728cd0dcd89e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5df2e72bcf034ab89ec0a00463bc90a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:51Z,use_quota=True,user_id='ce90d333a311431ab48e54e2ac30c747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Creating volume a9809e72-1847-4258-b04a-728cd0dcd89e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:51 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e 1073741824 Sep 29 12:37:51 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:51 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Flow 'volume_create_manager' (495ccfc2-e028-4a3f-9380-6811f544014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56eb85d-286a-423b-a9ea-d8e507b8ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e 1073741824" returned: 0 in 0.583s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56eb85d-286a-423b-a9ea-d8e507b8ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235248454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e26ccdc-970f-4066-9986-3668be77f1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d8d1e26ec445da9b9836944d539565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:52Z,use_quota=True,user_id='556c93a658484fc5837af2c162bd6f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f771608-7f00-4873-a34e-8aeb328dd2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f771608-7f00-4873-a34e-8aeb328dd2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5606428-3ee4-4e7b-885b-97f8629f5b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5606428-3ee4-4e7b-885b-97f8629f5b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e26ccdc-970f-4066-9986-3668be77f1ac', 'volume_name': 'volume-0e26ccdc-970f-4066-9986-3668be77f1ac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2b7568-ae1d-43a3-a6e2-c64f1a8ad44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2b7568-ae1d-43a3-a6e2-c64f1a8ad44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5ba0f9-7aab-4f98-ad97-bd1fec88a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Volume 0e26ccdc-970f-4066-9986-3668be77f1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e26ccdc-970f-4066-9986-3668be77f1ac', 'volume_size': 1} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=143,cinder:UPDATE=172,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:37:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:51 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e Sep 29 12:37:51 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:52 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e" returned: 0 in 0.393s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235248454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e26ccdc-970f-4066-9986-3668be77f1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d8d1e26ec445da9b9836944d539565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:52Z,use_quota=True,user_id='556c93a658484fc5837af2c162bd6f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Creating volume 0e26ccdc-970f-4066-9986-3668be77f1ac {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:52 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=161,cinder:DELETE=12,cinder:SELECT=159,cinder:INSERT=41 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df29f37-af6a-43ca-aa3a-5ffa57ed0a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9809e72-1847-4258-b04a-728cd0dcd89e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac 1073741824 Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff414d-b42c-4e2c-80bd-6b2bdf79f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Volume volume-a9809e72-1847-4258-b04a-728cd0dcd89e (a9809e72-1847-4258-b04a-728cd0dcd89e): created successfully Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff414d-b42c-4e2c-80bd-6b2bdf79f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Flow 'volume_create_manager' (8766e973-8a5d-4e86-87d4-9d9c61ebb04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-4dfc76a2-7035-4715-8ffb-6715bb0dabc1 req-49dd1139-32f0-4cfb-8119-a72af74d467e tempest-VolumesGetTestJSON-290776243 None] Created volume successfully. Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Flow 'volume_create_manager' (40874478-09ec-4cf2-b884-2b02fdd5694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b9700e-f682-4336-b567-9a3b7fb047b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b9700e-f682-4336-b567-9a3b7fb047b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890901273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da35fcc4-e838-4a32-9120-3791cdb8d9d4,host='devstack@QuobyteHD#QuobyteHD',id=5d575a7d-98ff-4368-9068-12bb7541a5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2985414e593143608df291bcccba51a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:53Z,use_quota=True,user_id='0ebdc7ba728c401fa2153c2dc22565bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e41748c-a1f5-4e5d-9738-14f26b640c64),volume_type_id=0e41748c-a1f5-4e5d-9738-14f26b640c64)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6b2a85-7337-40ef-a320-f9195c3e76c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6b2a85-7337-40ef-a320-f9195c3e76c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9fcfdd-7940-412b-be6f-89c1ff7f0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9fcfdd-7940-412b-be6f-89c1ff7f0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d575a7d-98ff-4368-9068-12bb7541a5ce', 'volume_name': 'volume-5d575a7d-98ff-4368-9068-12bb7541a5ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3473ff-8b3c-484b-a7a2-5dfe53a92698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3473ff-8b3c-484b-a7a2-5dfe53a92698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2b0138-740d-49c6-b205-bd39fd68707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Volume 5d575a7d-98ff-4368-9068-12bb7541a5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d575a7d-98ff-4368-9068-12bb7541a5ce', 'volume_size': 1} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:52 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac 1073741824" returned: 0 in 0.626s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:52 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac Sep 29 12:37:52 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:53 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac" returned: 0 in 0.279s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da35fcc4-e838-4a32-9120-3791cdb8d9d4,created_at=2026-09-29T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890901273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da35fcc4-e838-4a32-9120-3791cdb8d9d4,host='devstack@QuobyteHD#QuobyteHD',id=5d575a7d-98ff-4368-9068-12bb7541a5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2985414e593143608df291bcccba51a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:53Z,use_quota=True,user_id='0ebdc7ba728c401fa2153c2dc22565bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e41748c-a1f5-4e5d-9738-14f26b640c64),volume_type_id=0e41748c-a1f5-4e5d-9738-14f26b640c64)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Creating volume 5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:37:53 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5ba0f9-7aab-4f98-ad97-bd1fec88a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e26ccdc-970f-4066-9986-3668be77f1ac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:53 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce 1073741824 Sep 29 12:37:53 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1ab13a-fbeb-467f-a877-2a210d155bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Volume volume-0e26ccdc-970f-4066-9986-3668be77f1ac (0e26ccdc-970f-4066-9986-3668be77f1ac): created successfully Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1ab13a-fbeb-467f-a877-2a210d155bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Flow 'volume_create_manager' (495ccfc2-e028-4a3f-9380-6811f544014e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4025ab43-4b6e-4ae4-8a7e-b218e3091287 tempest-VolumesTransfersV355Test-672444275 None] Created volume successfully. Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Acquiring lock "cinder-a9809e72-1847-4258-b04a-728cd0dcd89e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "cinder-a9809e72-1847-4258-b04a-728cd0dcd89e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Acquiring lock "cinder-quobyte-a9809e72-1847-4258-b04a-728cd0dcd89e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "cinder-quobyte-a9809e72-1847-4258-b04a-728cd0dcd89e" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ef511-a5f9-4406-b8bf-aff64db0a5a8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:53 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e Sep 29 12:37:53 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:53 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce 1073741824" returned: 0 in 0.760s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:53 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:37:53 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:54 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2b0138-740d-49c6-b205-bd39fd68707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d575a7d-98ff-4368-9068-12bb7541a5ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482d5ef-8daa-41a6-b590-1858e4dd141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:37:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Volume volume-5d575a7d-98ff-4368-9068-12bb7541a5ce (5d575a7d-98ff-4368-9068-12bb7541a5ce): created successfully Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482d5ef-8daa-41a6-b590-1858e4dd141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Flow 'volume_create_manager' (40874478-09ec-4cf2-b884-2b02fdd5694c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "cinder-0e26ccdc-970f-4066-9986-3668be77f1ac-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-0e26ccdc-970f-4066-9986-3668be77f1ac-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1542f99b-a388-46a4-9963-8ce51f223ac5 tempest-GroupsV314Test-999990677 None] Created volume successfully. Sep 29 12:37:54 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "cinder-quobyte-0e26ccdc-970f-4066-9986-3668be77f1ac" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:54 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e Sep 29 12:37:54 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-quobyte-0e26ccdc-970f-4066-9986-3668be77f1ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d850f35-ad74-4540-ae41-d01484f375b3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:54 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac Sep 29 12:37:54 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:54 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9809e72-1847-4258-b04a-728cd0dcd89e" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "cinder-quobyte-a9809e72-1847-4258-b04a-728cd0dcd89e" released by "delete_volume" :: held 1.082s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.quota [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Created reservations ['b2afe99b-9154-4fb9-b425-6ab4033252b6', '4104a12f-984c-4095-a09d-a89c09f7690b', 'fff0b755-58fb-4441-92a7-6a28f9a84e12', '3410eeef-8ad4-4eaa-bfc8-3c977e0eeed2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:54 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:54 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:54 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:54 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac Sep 29 12:37:54 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:55 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0e26ccdc-970f-4066-9986-3668be77f1ac" returned: 0 in 0.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:55 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.315s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.manager [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-quobyte-0e26ccdc-970f-4066-9986-3668be77f1ac" released by "delete_volume" :: held 0.780s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Deleted volume successfully. Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-6be1af7f-34ea-4eb5-847d-429c969c5694 req-1c82fcff-df69-4e8a-a503-d72e664d919a tempest-VolumesGetTestJSON-290776243 None] Lock "cinder-a9809e72-1847-4258-b04a-728cd0dcd89e-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Created reservations ['b926ba50-c241-418d-9b10-4ae0bc29e73e', 'fd1bd79a-0a01-4f8d-b3db-cd295892ff69', '8cdb3606-81b9-4c1c-b0b9-92e3916a3dab', '25bff6ba-7a10-4321-9c2f-37a1f685c4ea'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:55 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:37:55 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:55 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:37:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Deleted volume successfully. Sep 29 12:37:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dbdaea38-7bd9-4e6d-afa1-a3100e62b866 tempest-VolumesTransfersV355Test-114902086 None] Lock "cinder-0e26ccdc-970f-4066-9986-3668be77f1ac-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:56 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Cloning volume 5d575a7d-98ff-4368-9068-12bb7541a5ce to volume fa081f56-dd3f-4133-9185-8c67ea9ef395 Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Creating offline snapshot 24257360-bc48-4dfc-ac51-04dba0b91cfe of volume 5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a54707-ff80-4d2e-81e1-687cb5cdc939]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:56 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:37:56 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:56 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.534s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:56 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe 1G Sep 29 12:37:56 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:57 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe 1G" returned: 0 in 0.692s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d575a7d-98ff-4368-9068-12bb7541a5ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:57 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d575a7d-98ff-4368-9068-12bb7541a5ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:37:57 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:58 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d575a7d-98ff-4368-9068-12bb7541a5ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:58 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:58 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:37:58 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:58 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.354s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:58 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info Sep 29 12:37:58 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:58 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:58 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:37:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:58 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info Sep 29 12:37:58 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:59 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.info" returned: 0 in 0.370s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Acquiring lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] snapshot: 24257360-bc48-4dfc-ac51-04dba0b91cfe, volume: fa081f56-dd3f-4133-9185-8c67ea9ef395, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cfc767-43ea-4736-addb-ea496442af4d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:37:59 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:37:59 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:37:59 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.556s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d575a7d-98ff-4368-9068-12bb7541a5ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c1237-e66c-4bd1-9727-3d649a55646c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:37:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:00 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:38:00 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:00 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:38:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:38:00 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:38:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:00 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 Sep 29 12:38:00 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:08 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=21,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:38:08 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:DELETE=2,cinder:SELECT=16,cinder:UPDATE=25,cinder:INSERT=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:38:09 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395" returned: 0 in 8.878s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:38:09 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Converted 1024.00 MB image at 115.31 MB/s Sep 29 12:38:09 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:09 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 Sep 29 12:38:09 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:09 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395" returned: 0 in 0.425s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" released by "_copy_volume_from_snapshot" :: held 10.443s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Acquiring lock "cinder-quobyte-24257360-bc48-4dfc-ac51-04dba0b91cfe" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-24257360-bc48-4dfc-ac51-04dba0b91cfe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Deleting offline snapshot 24257360-bc48-4dfc-ac51-04dba0b91cfe of volume 5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] snapshot_file for this snap is: volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9effee13-9784-4836-ae1f-5aa46a4d0ca2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:10 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:38:10 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Flow 'volume_create_manager' (556981f6-a0a2-4a0d-95f5-aeb0c327e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d041441d-226e-4288-8afb-638a5381511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d041441d-226e-4288-8afb-638a5381511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-896938485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1840110f-8731-4b66-ab8a-7639833e007a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315d4626ca4845bcb5a239ff4549b253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:10Z,use_quota=True,user_id='06669748bddc458e84692db690dd1ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634f0d95-93c5-4853-a508-8e8ee8fa4af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634f0d95-93c5-4853-a508-8e8ee8fa4af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcce70f-eb9c-4f73-aef7-e268f61b1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:10 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcce70f-eb9c-4f73-aef7-e268f61b1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1840110f-8731-4b66-ab8a-7639833e007a', 'volume_name': 'volume-1840110f-8731-4b66-ab8a-7639833e007a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fdbfdd-4f99-42ea-96a2-ee19f2412807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fdbfdd-4f99-42ea-96a2-ee19f2412807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8630020c-4ba8-4f9f-8d88-ba5024becebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Volume 1840110f-8731-4b66-ab8a-7639833e007a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1840110f-8731-4b66-ab8a-7639833e007a', 'volume_size': 1} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.644s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d575a7d-98ff-4368-9068-12bb7541a5ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[96219e66-59ee-403e-8a8f-e1ed1794a1d6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:10 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:38:10 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:11 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.781s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:11 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:38:11 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:11 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:11 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe Sep 29 12:38:11 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:12 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce.24257360-bc48-4dfc-ac51-04dba0b91cfe" returned: 0 in 0.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-24257360-bc48-4dfc-ac51-04dba0b91cfe" released by "_delete_snapshot" :: held 2.296s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.968s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-896938485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1840110f-8731-4b66-ab8a-7639833e007a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315d4626ca4845bcb5a239ff4549b253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:10Z,use_quota=True,user_id='06669748bddc458e84692db690dd1ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Creating volume 1840110f-8731-4b66-ab8a-7639833e007a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:12 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a 1073741824 Sep 29 12:38:12 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1d7ce55-b6c6-4978-b874-f64c74caf5d3 tempest-GroupsV314Test-999990677 None] Create group from source-group-da35fcc4-e838-4a32-9120-3791cdb8d9d4 completed successfully. Sep 29 12:38:12 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a 1073741824" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:12 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a Sep 29 12:38:12 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-7959880e-eae7-43b9-a0a5-7df7f8a59c9d tempest-ServerActionsTestOtherA-1845306863 None] Terminate volume connection completed successfully. Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-7959880e-eae7-43b9-a0a5-7df7f8a59c9d tempest-ServerActionsTestOtherA-1845306863 None] Deleting attachment 2cc2489f-4e11-43cb-baea-3553ef4a0143. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:38:13 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a" returned: 0 in 0.321s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8630020c-4ba8-4f9f-8d88-ba5024becebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1840110f-8731-4b66-ab8a-7639833e007a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdce392-f963-457a-a0f6-fbd889a583be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Volume volume-1840110f-8731-4b66-ab8a-7639833e007a (1840110f-8731-4b66-ab8a-7639833e007a): created successfully Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdce392-f963-457a-a0f6-fbd889a583be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Flow 'volume_create_manager' (556981f6-a0a2-4a0d-95f5-aeb0c327e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4baeb5fb-55ba-4f03-b5bb-6bc8dc5d236e tempest-VolumesTransfersV357Test-2030258775 None] Created volume successfully. Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "cinder-013cf800-f12f-4845-80ad-7a9c9a5483f9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-013cf800-f12f-4845-80ad-7a9c9a5483f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "cinder-quobyte-013cf800-f12f-4845-80ad-7a9c9a5483f9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-quobyte-013cf800-f12f-4845-80ad-7a9c9a5483f9" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de4067-26a9-4d5c-bb55-8caee2ef07e4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:13 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 Sep 29 12:38:13 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Acquiring lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" acquired by "delete_volume" :: waited 0.050s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e382f7-bc53-4a49-9a03-deeddf5f9e0e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:14 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9" returned: 0 in 0.730s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:14 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9 Sep 29 12:38:14 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:14 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 Sep 29 12:38:14 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "cinder-1e2adcf6-078b-4b86-af7d-be3c86b29405-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-1e2adcf6-078b-4b86-af7d-be3c86b29405-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "cinder-quobyte-1e2adcf6-078b-4b86-af7d-be3c86b29405" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-quobyte-1e2adcf6-078b-4b86-af7d-be3c86b29405" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:14 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-013cf800-f12f-4845-80ad-7a9c9a5483f9" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d46df-5c22-4198-8fef-ddc3bbe5c3a2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-quobyte-013cf800-f12f-4845-80ad-7a9c9a5483f9" released by "delete_volume" :: held 1.107s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.quota [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Created reservations ['320b631e-bcdc-4348-9a6d-238399eba4ff', '3b96936b-337a-43c8-bf7b-9e2cf67c4a75', 'bf22b310-0c4c-46ef-9fed-fd27b798b0fa', '79565398-531e-422c-a25a-9350984e4b88'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:14 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395" returned: 0 in 0.578s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:14 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 Sep 29 12:38:14 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:14 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395 Sep 29 12:38:14 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:14 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:14 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:15 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.manager [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:15 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Deleted volume successfully. Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fa081f56-dd3f-4133-9185-8c67ea9ef395" returned: 0 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-fa081f56-dd3f-4133-9185-8c67ea9ef395" released by "delete_volume" :: held 1.058s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-e7008273-ecc5-4878-91a6-ac85b4741111 req-c0b942e5-b835-479e-8877-9726550c2c7f tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-013cf800-f12f-4845-80ad-7a9c9a5483f9-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:15 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405" returned: 0 in 0.631s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:15 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405 Sep 29 12:38:15 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dc6756f3-4033-482b-9adc-efcc18573904 tempest-VolumesTransfersV357Test-1563124257 None] Transfer volume completed successfully. Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Created reservations ['6105783f-e072-4080-99a0-2c075a13645f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:15 devstack cinder-volume[86763]: WARNING cinder.quota [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-162294904 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-162294904, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:38:15 devstack cinder-volume[86763]: WARNING cinder.quota [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-162294904 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-162294904, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Created reservations ['df67c201-f3f3-4165-8dc2-12a0ec5ef911', 'b814b52a-f08b-4f70-94a6-321fe15dc2b7', '66f1df97-1d77-4af5-b0e6-6cbc8850baf5', 'f60e5de0-23bc-4074-b78c-531d13a0c891'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:15 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1e2adcf6-078b-4b86-af7d-be3c86b29405" returned: 0 in 0.351s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-quobyte-1e2adcf6-078b-4b86-af7d-be3c86b29405" released by "delete_volume" :: held 1.064s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:15 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:15 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Created reservations ['69938245-0549-4757-87a6-4b7a4168cf68', 'e55e9c88-edf5-4e49-b6ec-7b07d31123ad', 'de8f2d9c-4a90-43d5-8642-30293be0e586', '917a941d-56ce-45db-859f-48bd60ca78f4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:15 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:15 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:15 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.318s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-78cbcf6e-a73c-4b48-9fbc-a31ed601d077 tempest-GroupsV314Test-999990677 None] Delete group completed successfully. Sep 29 12:38:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "cinder-1840110f-8731-4b66-ab8a-7639833e007a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-1840110f-8731-4b66-ab8a-7639833e007a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "cinder-quobyte-1840110f-8731-4b66-ab8a-7639833e007a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-quobyte-1840110f-8731-4b66-ab8a-7639833e007a" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e6ee5-f2e2-4b58-93fe-a466e206a216]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:16 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.323s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Deleted volume successfully. Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-746d3c5f-52a2-42d7-b259-78b549e67af3 tempest-ServerActionsTestOtherA-1845306863 None] Lock "cinder-1e2adcf6-078b-4b86-af7d-be3c86b29405-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:16 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a Sep 29 12:38:16 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:16 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a" returned: 0 in 0.492s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:16 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a Sep 29 12:38:16 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:17 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1840110f-8731-4b66-ab8a-7639833e007a" returned: 0 in 0.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Acquiring lock "cinder-quobyte-5d575a7d-98ff-4368-9068-12bb7541a5ce" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-quobyte-1840110f-8731-4b66-ab8a-7639833e007a" released by "delete_volume" :: held 1.126s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-5d575a7d-98ff-4368-9068-12bb7541a5ce" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc24f3-6251-4003-972c-4eaa232b57d1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Created reservations ['2d05a13d-b0f1-4ca7-81b7-17e5ba132ca9', '66c78b58-aa00-4dff-8059-c2d3f88b3429', '20e06529-360e-4233-8b30-cde65c55bbb4', '4dbd9b00-861e-4ce9-a0bd-d9120057f8ae'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:17 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:17 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:17 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:17 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:17 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.600s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:17 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:17 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:17 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce Sep 29 12:38:17 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Deleted volume successfully. Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b47545a2-542d-4ec2-ab4a-066903eae6df tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-1840110f-8731-4b66-ab8a-7639833e007a-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:18 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5d575a7d-98ff-4368-9068-12bb7541a5ce" returned: 0 in 0.332s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Lock "cinder-quobyte-5d575a7d-98ff-4368-9068-12bb7541a5ce" released by "delete_volume" :: held 1.050s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Created reservations ['6372f3d7-5646-46bb-b59f-31ef70215785'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Created reservations ['21b54b52-b5ad-42f5-8617-788c31e023cf', '3d09958d-a726-45b9-a1c8-c557388d040e', '39a7264e-df10-4b02-a37e-e020a4e3b086', '4c665125-f991-45bc-8070-d4cbfe66e6c1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:18 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:18 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:18 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a8d26c38-ce1f-4abe-b407-bd90cb44efd7 tempest-GroupsV314Test-999990677 None] Delete group completed successfully. Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Flow 'volume_create_manager' (7f307529-2d76-4202-8042-fce9444fa399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc350fd-7fc3-42b4-828b-f58520b5f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc350fd-7fc3-42b4-828b-f58520b5f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-62130618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6f3123-6934-4b3c-8b8d-43268528717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315d4626ca4845bcb5a239ff4549b253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:19Z,use_quota=True,user_id='06669748bddc458e84692db690dd1ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e7c45d-37e8-471d-bbb7-7198a75b0954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e7c45d-37e8-471d-bbb7-7198a75b0954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8edf7d6-1e72-4cfd-a467-84d49eb31211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8edf7d6-1e72-4cfd-a467-84d49eb31211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6f3123-6934-4b3c-8b8d-43268528717e', 'volume_name': 'volume-fe6f3123-6934-4b3c-8b8d-43268528717e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c246a9ae-6386-4a1c-99d7-391c26c4080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c246a9ae-6386-4a1c-99d7-391c26c4080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b4583-02d6-47b7-83c1-3786e7089bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Volume fe6f3123-6934-4b3c-8b8d-43268528717e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6f3123-6934-4b3c-8b8d-43268528717e', 'volume_size': 1} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-62130618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6f3123-6934-4b3c-8b8d-43268528717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315d4626ca4845bcb5a239ff4549b253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:19Z,use_quota=True,user_id='06669748bddc458e84692db690dd1ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Creating volume fe6f3123-6934-4b3c-8b8d-43268528717e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:19 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e 1073741824 Sep 29 12:38:19 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:19 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e 1073741824" returned: 0 in 0.603s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:20 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e Sep 29 12:38:20 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:20 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e" returned: 0 in 0.320s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b4583-02d6-47b7-83c1-3786e7089bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6f3123-6934-4b3c-8b8d-43268528717e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28587d3f-1007-41c0-93d9-d42bfb327244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Volume volume-fe6f3123-6934-4b3c-8b8d-43268528717e (fe6f3123-6934-4b3c-8b8d-43268528717e): created successfully Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28587d3f-1007-41c0-93d9-d42bfb327244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Flow 'volume_create_manager' (7f307529-2d76-4202-8042-fce9444fa399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8102e137-d7d3-4f9b-aaba-ae872a3853f1 tempest-VolumesTransfersV357Test-2030258775 None] Created volume successfully. Sep 29 12:38:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "cinder-fe6f3123-6934-4b3c-8b8d-43268528717e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-fe6f3123-6934-4b3c-8b8d-43268528717e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "cinder-quobyte-fe6f3123-6934-4b3c-8b8d-43268528717e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-quobyte-fe6f3123-6934-4b3c-8b8d-43268528717e" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32b726-edaf-4c57-b0e8-0d2ae2f39f64]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:22 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e Sep 29 12:38:22 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:22 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:22 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e Sep 29 12:38:22 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:22 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fe6f3123-6934-4b3c-8b8d-43268528717e" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-quobyte-fe6f3123-6934-4b3c-8b8d-43268528717e" released by "delete_volume" :: held 0.878s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Created reservations ['26f66e27-dd09-4e4b-876e-2b468ddb5716', 'db347062-1252-4b18-95ad-51a5ecb312a3', '1dd6bd26-9bd9-42e3-94eb-c9c6ceb85310', 'c237bd2f-6d3d-439a-8e14-80e697287101'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:23 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:23 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:23 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Deleted volume successfully. Sep 29 12:38:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74756ce6-85f1-4b4b-93df-1455917b455e tempest-VolumesTransfersV357Test-495665485 None] Lock "cinder-fe6f3123-6934-4b3c-8b8d-43268528717e-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Flow 'volume_create_manager' (7b17fdce-af3c-47cc-9298-e20c2ba9c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f16ba51-0a10-4040-a8d4-d794add6a396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f16ba51-0a10-4040-a8d4-d794add6a396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1244496140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538b7d1d-d037-40c0-a4c8-0e9ef9bc0622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f87c3d360a4997af9bdbdc59afbcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:26Z,use_quota=True,user_id='169bfa82b32f43e68033d0752a2ef839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2bdd16-454b-4237-ab99-c2f862465c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2bdd16-454b-4237-ab99-c2f862465c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468f4b7-3ac7-459b-821f-8171a045f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468f4b7-3ac7-459b-821f-8171a045f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538b7d1d-d037-40c0-a4c8-0e9ef9bc0622', 'volume_name': 'volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1411872b-fbec-4555-aa8b-7895a59e6509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1411872b-fbec-4555-aa8b-7895a59e6509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4c16bc-3777-4473-9368-95ee27df8305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume 538b7d1d-d037-40c0-a4c8-0e9ef9bc0622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622', 'volume_size': 1} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1244496140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538b7d1d-d037-40c0-a4c8-0e9ef9bc0622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f87c3d360a4997af9bdbdc59afbcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:26Z,use_quota=True,user_id='169bfa82b32f43e68033d0752a2ef839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Creating volume 538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:25 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 1073741824 Sep 29 12:38:25 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:26 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 1073741824" returned: 0 in 0.743s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:26 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 Sep 29 12:38:26 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:27 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4c16bc-3777-4473-9368-95ee27df8305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aae025-a0f5-4103-895e-34d84330a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 (538b7d1d-d037-40c0-a4c8-0e9ef9bc0622): created successfully Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aae025-a0f5-4103-895e-34d84330a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Flow 'volume_create_manager' (7b17fdce-af3c-47cc-9298-e20c2ba9c90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-27116f19-1d55-443b-9ebd-3ce26b1e72c3 tempest-VolumeQuotasAdminTestJSON-1935444212 None] Created volume successfully. Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "cinder-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "cinder-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "cinder-quobyte-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "cinder-quobyte-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac07b3-afa7-4b1e-a732-0e2732baf13a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:28 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 Sep 29 12:38:28 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:28 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" returned: 0 in 0.495s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:28 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622 Sep 29 12:38:28 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:28 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" returned: 0 in 0.324s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "cinder-quobyte-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622" released by "delete_volume" :: held 0.903s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Created reservations ['eba3b3bb-e89c-4b27-bbda-dbb8dda5f3bf', 'f9c37a88-d448-4c27-bf3a-73bb169cc261', '14b01049-e23f-4262-a1e0-acd4610ee339', '971acd99-8950-480b-b11c-23b2a866a1c5'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:29 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:29 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:29 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Deleted volume successfully. Sep 29 12:38:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1522e6ff-c138-447a-87db-d55038b553ac tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "cinder-538b7d1d-d037-40c0-a4c8-0e9ef9bc0622-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Flow 'volume_create_manager' (d88d3ec3-60e9-4662-97a4-d78e5a056d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2f466-cddb-44d2-8141-e53c126dc712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:30 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:30 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2f466-cddb-44d2-8141-e53c126dc712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-84563101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db24e2eb-6e09-4a1f-aa12-62982ea98fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f87c3d360a4997af9bdbdc59afbcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:30Z,use_quota=True,user_id='169bfa82b32f43e68033d0752a2ef839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9a771-c04a-4f1f-a2a5-d5b7b9f8b44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9a771-c04a-4f1f-a2a5-d5b7b9f8b44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efad2d17-6c20-4d97-b1cc-efe1dcb4f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efad2d17-6c20-4d97-b1cc-efe1dcb4f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db24e2eb-6e09-4a1f-aa12-62982ea98fa9', 'volume_name': 'volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f92ba2-fac8-44f3-a0c0-daa6cf78b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f92ba2-fac8-44f3-a0c0-daa6cf78b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9428a243-3956-457c-8efc-5d5e9c4a250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume db24e2eb-6e09-4a1f-aa12-62982ea98fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9', 'volume_size': 1} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-84563101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db24e2eb-6e09-4a1f-aa12-62982ea98fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f87c3d360a4997af9bdbdc59afbcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:30Z,use_quota=True,user_id='169bfa82b32f43e68033d0752a2ef839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Creating volume db24e2eb-6e09-4a1f-aa12-62982ea98fa9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:30 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 1073741824 Sep 29 12:38:30 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:30 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.425s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:38:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:38:31 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 1073741824" returned: 0 in 0.725s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:31 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 Sep 29 12:38:31 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:31 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9428a243-3956-457c-8efc-5d5e9c4a250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78855629-f2fc-4095-b9d8-323709a19b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Volume volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 (db24e2eb-6e09-4a1f-aa12-62982ea98fa9): created successfully Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78855629-f2fc-4095-b9d8-323709a19b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Flow 'volume_create_manager' (d88d3ec3-60e9-4662-97a4-d78e5a056d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ae6d8aca-4155-489f-aa2c-c0dbad003ffa tempest-VolumeQuotasAdminTestJSON-1935444212 None] Created volume successfully. Sep 29 12:38:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7b3e15dd-74f6-4f88-9c61-6a7ca73f2e17 tempest-VolumeQuotasAdminTestJSON-1354653190 None] Transfer volume completed successfully. Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Acquiring lock "cinder-db24e2eb-6e09-4a1f-aa12-62982ea98fa9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "cinder-db24e2eb-6e09-4a1f-aa12-62982ea98fa9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Acquiring lock "cinder-quobyte-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "cinder-quobyte-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[526ebc61-49af-4931-9965-d20840d68003]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:33 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 Sep 29 12:38:33 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:34 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" returned: 0 in 0.535s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:34 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9 Sep 29 12:38:34 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:34 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "cinder-quobyte-db24e2eb-6e09-4a1f-aa12-62982ea98fa9" released by "delete_volume" :: held 0.902s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Created reservations ['bad48706-5b94-4e42-9291-6b6bbe861ccd', 'c3ee2884-5e06-484a-989d-65151a061294', '00517350-5e40-476a-914f-d97cb91322e8', 'dfaf1b44-c0bb-461d-8796-87fb86138940'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:34 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:34 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:35 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.362s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Deleted volume successfully. Sep 29 12:38:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f00569a8-da4d-4df0-a3b3-343bbf4972d5 tempest-VolumeQuotasAdminTestJSON-1761767093 None] Lock "cinder-db24e2eb-6e09-4a1f-aa12-62982ea98fa9-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:44 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=83,cinder:SELECT=59,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:38:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=58,cinder:UPDATE=87,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Flow 'volume_create_manager' (c787fedf-23a7-42d0-b0c6-73a47b88faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d476cf-1f80-48bb-b054-c19772e16d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d476cf-1f80-48bb-b054-c19772e16d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678024732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7413366-d296-4e1a-a77c-6867513cf0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe6bfb57b0a463893960e9a23c45958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:48Z,use_quota=True,user_id='ebe4a6d63e1b4cf0ac217c8c349d7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953214f0-476b-4e29-aa9b-4d54691802df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953214f0-476b-4e29-aa9b-4d54691802df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214c1d24-eb92-4097-9caa-0934b65cb537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214c1d24-eb92-4097-9caa-0934b65cb537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7413366-d296-4e1a-a77c-6867513cf0b7', 'volume_name': 'volume-a7413366-d296-4e1a-a77c-6867513cf0b7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54934cdd-ff05-44dd-a3dc-6717724b64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54934cdd-ff05-44dd-a3dc-6717724b64b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0a57c-aed4-4831-a519-d2227fb0ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Volume a7413366-d296-4e1a-a77c-6867513cf0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7413366-d296-4e1a-a77c-6867513cf0b7', 'volume_size': 1} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678024732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7413366-d296-4e1a-a77c-6867513cf0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe6bfb57b0a463893960e9a23c45958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:48Z,use_quota=True,user_id='ebe4a6d63e1b4cf0ac217c8c349d7337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Creating volume a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:48 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 1073741824 Sep 29 12:38:48 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:49 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 1073741824" returned: 0 in 0.824s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:49 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:38:49 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:50 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0a57c-aed4-4831-a519-d2227fb0ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7413366-d296-4e1a-a77c-6867513cf0b7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58eb87d-72d6-4552-8336-c0cbf1783348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Volume volume-a7413366-d296-4e1a-a77c-6867513cf0b7 (a7413366-d296-4e1a-a77c-6867513cf0b7): created successfully Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58eb87d-72d6-4552-8336-c0cbf1783348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Flow 'volume_create_manager' (c787fedf-23a7-42d0-b0c6-73a47b88faf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9dac70ef-900b-410a-85b0-8bb6be68d555 tempest-VolumesActionsTest-1996071789 None] Created volume successfully. Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Flow 'volume_create_manager' (76749744-44fa-4298-bedc-478255a2fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53485a4-32a0-49ea-8d61-c9735b218d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53485a4-32a0-49ea-8d61-c9735b218d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1469245424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aaf2d80-8a1d-4ebe-956f-ec3f27e98661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7d0b31b79c48b0989f860ffa422dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:53Z,use_quota=True,user_id='5e54c02f182d44c29cacfc0052147bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c22946-187a-4319-b3cb-6b45a8780f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c22946-187a-4319-b3cb-6b45a8780f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11927c-5107-40e0-a6e5-f38dde331c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11927c-5107-40e0-a6e5-f38dde331c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aaf2d80-8a1d-4ebe-956f-ec3f27e98661', 'volume_name': 'volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be765adc-f179-42b8-8814-21db0557ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be765adc-f179-42b8-8814-21db0557ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e560b-07e1-4b32-b68c-ebb1ec873354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Volume 0aaf2d80-8a1d-4ebe-956f-ec3f27e98661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661', 'volume_size': 1} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1469245424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aaf2d80-8a1d-4ebe-956f-ec3f27e98661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7d0b31b79c48b0989f860ffa422dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:53Z,use_quota=True,user_id='5e54c02f182d44c29cacfc0052147bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Creating volume 0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:53 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:53 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 1073741824 Sep 29 12:38:53 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Flow 'volume_create_manager' (b6f30511-86ee-46f9-8079-51c6033330e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e640e-f1f9-4892-8ad1-f51f20fdb64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e640e-f1f9-4892-8ad1-f51f20fdb64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1700743799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa165b69-76fd-48f3-ae32-8a00a71d384b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ad36f0b13423abba74b65bfd17696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:54Z,use_quota=True,user_id='e7847f6e0f8948e3820539d87a98aa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d641623-c7b8-475f-8e60-3b147a639ad6),volume_type_id=6d641623-c7b8-475f-8e60-3b147a639ad6)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e9ad51-4dda-463b-9c38-c641f15215b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e9ad51-4dda-463b-9c38-c641f15215b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f96077-3a8f-4a1f-a949-282b549fc6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f96077-3a8f-4a1f-a949-282b549fc6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa165b69-76fd-48f3-ae32-8a00a71d384b', 'volume_name': 'volume-aa165b69-76fd-48f3-ae32-8a00a71d384b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9916b4-4a02-429b-836c-a21800d325a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9916b4-4a02-429b-836c-a21800d325a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96827d71-82af-47cb-8724-46248cda7ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Volume aa165b69-76fd-48f3-ae32-8a00a71d384b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa165b69-76fd-48f3-ae32-8a00a71d384b', 'volume_size': 1} Sep 29 12:38:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:54 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 1073741824" returned: 0 in 0.983s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:54 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 Sep 29 12:38:54 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:55 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1700743799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa165b69-76fd-48f3-ae32-8a00a71d384b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ad36f0b13423abba74b65bfd17696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:54Z,use_quota=True,user_id='e7847f6e0f8948e3820539d87a98aa32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d641623-c7b8-475f-8e60-3b147a639ad6),volume_type_id=6d641623-c7b8-475f-8e60-3b147a639ad6)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Creating volume aa165b69-76fd-48f3-ae32-8a00a71d384b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:38:55 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:55 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b 1073741824 Sep 29 12:38:55 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e560b-07e1-4b32-b68c-ebb1ec873354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4b3811-da27-4572-8085-cfb8aab3fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Volume volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 (0aaf2d80-8a1d-4ebe-956f-ec3f27e98661): created successfully Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4b3811-da27-4572-8085-cfb8aab3fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Flow 'volume_create_manager' (76749744-44fa-4298-bedc-478255a2fab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-36ea7c72-3740-4275-87c7-ddd742e8ebb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Created volume successfully. Sep 29 12:38:55 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b 1073741824" returned: 0 in 0.859s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:56 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b Sep 29 12:38:56 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:56 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96827d71-82af-47cb-8724-46248cda7ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa165b69-76fd-48f3-ae32-8a00a71d384b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321f2d26-613c-4836-9721-d72bc78bc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:38:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Volume volume-aa165b69-76fd-48f3-ae32-8a00a71d384b (aa165b69-76fd-48f3-ae32-8a00a71d384b): created successfully Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321f2d26-613c-4836-9721-d72bc78bc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Flow 'volume_create_manager' (b6f30511-86ee-46f9-8079-51c6033330e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:38:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-86dccb18-32d5-46ff-a344-5102d7a7103d tempest-VolumeTypesAccessTest-19501982 None] Created volume successfully. Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Creating offline snapshot ee0b050b-3622-4829-a4a3-99de7ae521ae of volume 0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42dff1c-3ef7-4985-aeb0-812b387aad90]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Acquiring lock "cinder-aa165b69-76fd-48f3-ae32-8a00a71d384b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "cinder-aa165b69-76fd-48f3-ae32-8a00a71d384b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Acquiring lock "cinder-quobyte-aa165b69-76fd-48f3-ae32-8a00a71d384b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:38:57 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 Sep 29 12:38:57 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "cinder-quobyte-aa165b69-76fd-48f3-ae32-8a00a71d384b" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4cd71-2853-419d-ba69-b0a40dc8e4be]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:57 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b Sep 29 12:38:57 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:57 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" returned: 0 in 0.580s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:57 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae 1G Sep 29 12:38:57 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:57 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b" returned: 0 in 0.550s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:57 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b Sep 29 12:38:57 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:58 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aa165b69-76fd-48f3-ae32-8a00a71d384b" returned: 0 in 0.527s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "cinder-quobyte-aa165b69-76fd-48f3-ae32-8a00a71d384b" released by "delete_volume" :: held 1.177s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:58 devstack cinder-volume[86763]: WARNING cinder.quota [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1930572704 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1930572704, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:38:58 devstack cinder-volume[86763]: WARNING cinder.quota [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1930572704 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1930572704, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Created reservations ['7f374fbb-2e4a-4597-95b9-a5f30d818e8d', 'd379a76f-a88e-4f1e-8e72-05ba6c3c2594', '1b889533-96ae-4a17-a524-3bd7f494833a', 'dd70e563-9688-4bbd-93e1-a15f3b71adcd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:38:58 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae 1G" returned: 0 in 0.950s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:58 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae Sep 29 12:38:58 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:38:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:58 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:38:58 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:38:59 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.453s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:59 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:38:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Deleted volume successfully. Sep 29 12:38:59 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 29 12:38:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae" returned: 0 in 0.661s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:38:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae is being set with open permissions: ugo+rw Sep 29 12:38:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:38:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dca027b-b555-4775-8f8a-011af9c6650d tempest-VolumeTypesAccessTest-19501982 None] Lock "cinder-aa165b69-76fd-48f3-ae32-8a00a71d384b-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:38:59 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae Sep 29 12:38:59 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:00 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae" returned: 0 in 0.797s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:00 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info Sep 29 12:39:00 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:00 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info" returned: 0 in 0.575s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:00 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info is being set with open permissions: ugo+rw Sep 29 12:39:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:00 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info Sep 29 12:39:00 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:01 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.info" returned: 0 in 0.861s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-73b04237-25bb-4b4d-a6f9-ffc5056b87b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Create snapshot completed successfully Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "cinder-ee0b050b-3622-4829-a4a3-99de7ae521ae-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-ee0b050b-3622-4829-a4a3-99de7ae521ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "cinder-quobyte-ee0b050b-3622-4829-a4a3-99de7ae521ae" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-ee0b050b-3622-4829-a4a3-99de7ae521ae" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Deleting offline snapshot ee0b050b-3622-4829-a4a3-99de7ae521ae of volume 0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] snapshot_file for this snap is: volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7494ea-6bf7-453c-a76c-d1ff3c4ceaf3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:03 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae Sep 29 12:39:03 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:04 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae" returned: 0 in 1.047s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:39:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43a7fc-f903-40d5-8c18-21549e60c5b9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:04 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 Sep 29 12:39:04 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:05 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" returned: 0 in 0.841s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:05 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae Sep 29 12:39:05 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa7dc50f-263a-429d-8469-b476ad3e272d tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa7dc50f-263a-429d-8469-b476ad3e272d tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" acquired by "attach_volume" :: waited 0.064s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:06 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae" returned: 0 in 1.027s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:06 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae Sep 29 12:39:06 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fa7dc50f-263a-429d-8469-b476ad3e272d tempest-VolumesActionsTest-1996071789 None] Attaching volume a7413366-d296-4e1a-a77c-6867513cf0b7 to instance 4f17ddce-b1e1-4d1d-a091-a96397d38e3a at mountpoint /dev/vdb on host None. Sep 29 12:39:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fa7dc50f-263a-429d-8469-b476ad3e272d tempest-VolumesActionsTest-1996071789 None] Attach volume completed successfully. Sep 29 12:39:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa7dc50f-263a-429d-8469-b476ad3e272d tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" released by "attach_volume" :: held 0.284s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:07 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661.ee0b050b-3622-4829-a4a3-99de7ae521ae" returned: 0 in 0.626s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-851fbf78-cbba-4793-ad3e-14ab106d87d6 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-ee0b050b-3622-4829-a4a3-99de7ae521ae" released by "_delete_snapshot" :: held 3.856s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-851fbf78-cbba-4793-ad3e-14ab106d87d6 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" acquired by "detach_volume" :: waited 0.106s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-851fbf78-cbba-4793-ad3e-14ab106d87d6 tempest-VolumesActionsTest-1996071789 None] Detaching volume a7413366-d296-4e1a-a77c-6867513cf0b7 from instance 4f17ddce-b1e1-4d1d-a091-a96397d38e3a. Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" released by "delete_snapshot" :: held 3.934s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-851fbf78-cbba-4793-ad3e-14ab106d87d6 tempest-VolumesActionsTest-1996071789 None] Detach volume completed successfully. Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-851fbf78-cbba-4793-ad3e-14ab106d87d6 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" released by "detach_volume" :: held 0.337s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Created reservations ['e0959818-999e-4f86-8745-3b128f679acb', 'baf17507-3d4d-4de6-939d-97ec1286515b', '1a75d129-57fe-4e4b-9e13-0fe49b525258', '1346dc88-d2fc-4df7-88d2-9f5d81eb66cf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:39:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Delete snapshot completed successfully. Sep 29 12:39:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6271e07e-09ed-44ae-8213-3e624bacced9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-ee0b050b-3622-4829-a4a3-99de7ae521ae-delete_snapshot" released by "delete_snapshot" :: held 4.444s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "cinder-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" acquired by "delete_volume" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0bdbf-6c60-4596-869f-c79a627054ad]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:08 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 Sep 29 12:39:08 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:09 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" returned: 0 in 0.676s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:09 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661 Sep 29 12:39:09 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:09 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-quobyte-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661" released by "delete_volume" :: held 1.407s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Created reservations ['2f0b04bf-47f6-451b-99cc-bf315580a686', 'c0c2574b-0d38-477b-8b2d-d618fa28aa50', 'f2a33dd3-7bf3-452b-93fe-78a65d499311', '8d7b624b-3e58-43a0-8c3f-55a5ee8bf98d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:10 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:39:10 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:10 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.420s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:10 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:39:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Deleted volume successfully. Sep 29 12:39:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4c2c3a-40c3-4ae5-bc2e-2962818efbb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032253322 None] Lock "cinder-0aaf2d80-8a1d-4ebe-956f-ec3f27e98661-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:19 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=41,cinder:SELECT=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:39:20 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=29,cinder:INSERT=12,cinder:UPDATE=29,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Flow 'volume_create_manager' (c1338604-dff9-4742-9c65-cc158e6ba9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ec2ca-d5b0-47d0-ab1b-13dbef708d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ec2ca-d5b0-47d0-ab1b-13dbef708d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-157999986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c655284b-9721-43bc-995e-1cf2d3897059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affd8071fa6f46eca063d9a952ed6534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:25Z,use_quota=True,user_id='e626d561f8464caeb691f65b812132a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e80df30-e8e7-46d8-8906-c0b924af51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e80df30-e8e7-46d8-8906-c0b924af51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ccaaa3-9613-4aa4-8646-f84f80c2ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ccaaa3-9613-4aa4-8646-f84f80c2ad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c655284b-9721-43bc-995e-1cf2d3897059', 'volume_name': 'volume-c655284b-9721-43bc-995e-1cf2d3897059', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc676a6-b3d0-44c5-8fe1-bb668d1a848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc676a6-b3d0-44c5-8fe1-bb668d1a848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f83256-14eb-4daf-b5da-b32e22e6ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Volume c655284b-9721-43bc-995e-1cf2d3897059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c655284b-9721-43bc-995e-1cf2d3897059', 'volume_size': 1} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-157999986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c655284b-9721-43bc-995e-1cf2d3897059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affd8071fa6f46eca063d9a952ed6534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:25Z,use_quota=True,user_id='e626d561f8464caeb691f65b812132a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Creating volume c655284b-9721-43bc-995e-1cf2d3897059 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:39:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:39:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:25 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 1073741824 Sep 29 12:39:25 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:26 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 1073741824" returned: 0 in 0.851s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:26 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 Sep 29 12:39:26 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:27 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059" returned: 0 in 0.518s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f83256-14eb-4daf-b5da-b32e22e6ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c655284b-9721-43bc-995e-1cf2d3897059', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b693b159-926f-4000-9682-e328e314ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Volume volume-c655284b-9721-43bc-995e-1cf2d3897059 (c655284b-9721-43bc-995e-1cf2d3897059): created successfully Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b693b159-926f-4000-9682-e328e314ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Flow 'volume_create_manager' (c1338604-dff9-4742-9c65-cc158e6ba9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:39:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d49ce0e3-6dcd-4266-ae90-45288ad3b231 tempest-ServersNegativeTestJSON-1737824608 None] Created volume successfully. Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc83fd76-be10-471b-89e7-bd9f1c620f51 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc83fd76-be10-471b-89e7-bd9f1c620f51 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" acquired by "attach_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fc83fd76-be10-471b-89e7-bd9f1c620f51 tempest-VolumesActionsTest-1996071789 None] Attaching volume a7413366-d296-4e1a-a77c-6867513cf0b7 to instance 25fbab1c-b498-469c-909c-2957bc4e3e3b at mountpoint /dev/vdb on host None. Sep 29 12:39:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fc83fd76-be10-471b-89e7-bd9f1c620f51 tempest-VolumesActionsTest-1996071789 None] Attach volume completed successfully. Sep 29 12:39:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc83fd76-be10-471b-89e7-bd9f1c620f51 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7" released by "attach_volume" :: held 0.112s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03bd413e-70b0-487f-b200-8a215bf6006f tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03bd413e-70b0-487f-b200-8a215bf6006f tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-03bd413e-70b0-487f-b200-8a215bf6006f tempest-VolumesActionsTest-1996071789 None] Detaching volume a7413366-d296-4e1a-a77c-6867513cf0b7 from instance 25fbab1c-b498-469c-909c-2957bc4e3e3b. Sep 29 12:39:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-03bd413e-70b0-487f-b200-8a215bf6006f tempest-VolumesActionsTest-1996071789 None] Detach volume completed successfully. Sep 29 12:39:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03bd413e-70b0-487f-b200-8a215bf6006f tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Flow 'volume_create_manager' (8a765a39-3ef0-41fd-8bcd-66a53f56920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf496b-f1b7-4840-8132-57699fade797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:30 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:39:30 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf496b-f1b7-4840-8132-57699fade797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1504886630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b460b743-dd48-4f87-918b-f4e3a2189e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affd8071fa6f46eca063d9a952ed6534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:30Z,use_quota=True,user_id='e626d561f8464caeb691f65b812132a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf37bfb-6e90-4930-b77b-00d8d20c1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf37bfb-6e90-4930-b77b-00d8d20c1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd9078-3e3d-4515-8d89-68647e8f815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd9078-3e3d-4515-8d89-68647e8f815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b460b743-dd48-4f87-918b-f4e3a2189e8f', 'volume_name': 'volume-b460b743-dd48-4f87-918b-f4e3a2189e8f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d67c7-904d-4d18-85df-afc942a90087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d67c7-904d-4d18-85df-afc942a90087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1464ad16-e72e-4112-8a74-81625a9abe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Volume b460b743-dd48-4f87-918b-f4e3a2189e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b460b743-dd48-4f87-918b-f4e3a2189e8f', 'volume_size': 1} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1504886630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b460b743-dd48-4f87-918b-f4e3a2189e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affd8071fa6f46eca063d9a952ed6534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:30Z,use_quota=True,user_id='e626d561f8464caeb691f65b812132a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Creating volume b460b743-dd48-4f87-918b-f4e3a2189e8f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:39:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:30 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f 1073741824 Sep 29 12:39:30 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:30 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:39:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:39:31 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f 1073741824" returned: 0 in 0.768s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:31 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f Sep 29 12:39:31 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:31 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1464ad16-e72e-4112-8a74-81625a9abe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b460b743-dd48-4f87-918b-f4e3a2189e8f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45524b0c-cf36-4d22-9de9-27e80b6a9098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Volume volume-b460b743-dd48-4f87-918b-f4e3a2189e8f (b460b743-dd48-4f87-918b-f4e3a2189e8f): created successfully Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45524b0c-cf36-4d22-9de9-27e80b6a9098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Flow 'volume_create_manager' (8a765a39-3ef0-41fd-8bcd-66a53f56920a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:39:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-09ea2fd2-f14f-4c6c-b08c-22579ae1f1ea tempest-ServersNegativeTestJSON-1737824608 None] Created volume successfully. Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "cinder-b460b743-dd48-4f87-918b-f4e3a2189e8f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-b460b743-dd48-4f87-918b-f4e3a2189e8f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "cinder-quobyte-b460b743-dd48-4f87-918b-f4e3a2189e8f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-quobyte-b460b743-dd48-4f87-918b-f4e3a2189e8f" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f046f-2b08-4f1c-9edf-b287daccbcfb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:33 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f Sep 29 12:39:33 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:33 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f" returned: 0 in 0.512s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:33 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f Sep 29 12:39:33 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:34 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b460b743-dd48-4f87-918b-f4e3a2189e8f" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-quobyte-b460b743-dd48-4f87-918b-f4e3a2189e8f" released by "delete_volume" :: held 0.901s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Created reservations ['02e7e07a-c2a8-4123-bd38-3aaeb1957596', 'f6ae5d6e-38cf-434d-ba30-4ed918187246', '4301545a-b4d5-4f78-800c-990758250310', 'ef86d958-a757-4029-8d01-21730df18875'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "cinder-c655284b-9721-43bc-995e-1cf2d3897059-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:34 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:39:34 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-c655284b-9721-43bc-995e-1cf2d3897059-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b61e5c1-dd5c-4d03-a5b3-ddf426d22301]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "cinder-quobyte-c655284b-9721-43bc-995e-1cf2d3897059" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-quobyte-c655284b-9721-43bc-995e-1cf2d3897059" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c7160a-481b-4ec9-988f-7ed730f3cdcf]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:34 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:39:34 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:34 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 Sep 29 12:39:34 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:34 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.402s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:39:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Deleted volume successfully. Sep 29 12:39:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdf1d431-5aee-4fc1-b188-0397d6425758 tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-b460b743-dd48-4f87-918b-f4e3a2189e8f-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:35 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.559s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5bd69-d2ab-4c62-8f37-4ffb4939601b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:35 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059" returned: 0 in 0.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:35 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059 Sep 29 12:39:35 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:35 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:39:35 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:35 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c655284b-9721-43bc-995e-1cf2d3897059" returned: 0 in 0.352s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-quobyte-c655284b-9721-43bc-995e-1cf2d3897059" released by "delete_volume" :: held 0.964s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:35 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Created reservations ['69960899-2f9c-4ba7-b148-ac3688455537', '4dd62eb0-84f8-4d07-9532-513fc5b63733', 'a616d947-a66d-4947-9041-34e7775e2442', '12cff076-9afe-455c-881d-be394e89b2ed'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.bd6c58d4-d0dc-41b5-821f-540f9d9811cc_xxv5v6g.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:35 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.bd6c58d4-d0dc-41b5-821f-540f9d9811cc_xxv5v6g.img Sep 29 12:39:35 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:39:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:35 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:39:35 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:36 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.342s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:39:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Deleted volume successfully. Sep 29 12:39:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7f4341ec-0bb4-461f-8c61-fda2b2a5bf0c tempest-ServersNegativeTestJSON-1737824608 None] Lock "cinder-c655284b-9721-43bc-995e-1cf2d3897059-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Flow 'volume_create_manager' (2adb51b1-8624-4216-8784-76de06ad990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ad71ae-6ab3-4adb-9567-3a63f0b9d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ad71ae-6ab3-4adb-9567-3a63f0b9d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-194976345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3ee164-3054-44e6-910d-ada323aebbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dccf9a41934efaa93fa59ace9c16b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:40Z,use_quota=True,user_id='5b0f564234764da1ac77e7fb36870be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cace0313-29fc-46bc-bf99-e2466857cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cace0313-29fc-46bc-bf99-e2466857cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99ff8a5-edb6-4433-8bc2-5f71f700f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99ff8a5-edb6-4433-8bc2-5f71f700f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3ee164-3054-44e6-910d-ada323aebbfa', 'volume_name': 'volume-ed3ee164-3054-44e6-910d-ada323aebbfa', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faea21d-d076-411b-bbeb-9545ec95a238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faea21d-d076-411b-bbeb-9545ec95a238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:39:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675baffc-5006-4cfe-827b-d9ffaf2c8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:39:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Volume ed3ee164-3054-44e6-910d-ada323aebbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3ee164-3054-44e6-910d-ada323aebbfa', 'volume_size': 1} Sep 29 12:39:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:39:44 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.bd6c58d4-d0dc-41b5-821f-540f9d9811cc_xxv5v6g.img" returned: 0 in 8.975s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dab511-8dac-4192-86f7-614ce14c690d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:39:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:39:44 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:39:44 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:39:45 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 29 12:39:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.632s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:39:45 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.bd6c58d4-d0dc-41b5-821f-540f9d9811cc_xxv5v6g.img {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:39:45 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Converted 1024.00 MB image at 114.07 MB/s Sep 29 12:39:45 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] bd6c58d4-d0dc-41b5-821f-540f9d9811cc was raw, no need to convert to raw {{(pid=86763) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 12:39:55 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=29,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:39:55 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1,cinder:SELECT=17 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:40:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1604d3e2-b376-4102-8fb3-78b47239faac tempest-GroupSnapshotsV319Test-804615435 None] Group tempest-GroupSnapshotsV319Test-Group-1757006069: creating Sep 29 12:40:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1604d3e2-b376-4102-8fb3-78b47239faac tempest-GroupSnapshotsV319Test-804615435 None] Group tempest-GroupSnapshotsV319Test-Group-1757006069: created successfully Sep 29 12:40:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1604d3e2-b376-4102-8fb3-78b47239faac tempest-GroupSnapshotsV319Test-804615435 None] Create group completed successfully. Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Flow 'volume_create_manager' (0ed17e98-3575-4715-a78c-d0e3a68fca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d3d79f-9094-4b84-b0e2-dff18415a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d3d79f-9094-4b84-b0e2-dff18415a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397446676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc76b53e-5d08-4374-b078-f21017ded73f,host='devstack@QuobyteHD#QuobyteHD',id=402d8576-fb5c-4c99-879a-bd3c95ce7ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc8fd73fdf44b62a38613f461f1c476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:04Z,use_quota=True,user_id='d00be984fa5d4cc4ba684d79fec4d1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09281273-605c-4014-adc7-2e8bc58fdd3e),volume_type_id=09281273-605c-4014-adc7-2e8bc58fdd3e)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06349cac-7bdc-4a5e-a306-7b9e034f211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06349cac-7bdc-4a5e-a306-7b9e034f211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d3520-12a4-49f2-8e9d-50040db9f859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d3520-12a4-49f2-8e9d-50040db9f859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402d8576-fb5c-4c99-879a-bd3c95ce7ac1', 'volume_name': 'volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad20f23f-645c-4230-8681-7174d179711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad20f23f-645c-4230-8681-7174d179711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c68ad4c-38ff-4e2b-87f5-b37740f12147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Volume 402d8576-fb5c-4c99-879a-bd3c95ce7ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1', 'volume_size': 1} Sep 29 12:40:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (042a9866-d003-44ee-b317-976487b2eab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d9c42f-67d8-4026-b1ed-c4ff5df903fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d9c42f-67d8-4026-b1ed-c4ff5df903fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341769444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e982ee3-49be-4e88-9e2b-5f19c7096e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:11Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b4aa41-b88c-4ac7-abde-740cfd39beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b4aa41-b88c-4ac7-abde-740cfd39beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e9aed4-0a24-44eb-afbf-61172c95f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e9aed4-0a24-44eb-afbf-61172c95f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e982ee3-49be-4e88-9e2b-5f19c7096e5a', 'volume_name': 'volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980e8b29-87ed-4080-87b2-136637c7418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980e8b29-87ed-4080-87b2-136637c7418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cbb3f0-3a8e-4c1e-af6d-6ace5abf6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Volume 2e982ee3-49be-4e88-9e2b-5f19c7096e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a', 'volume_size': 1} Sep 29 12:40:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.588s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Uploaded volume to glance image-id: bd6c58d4-d0dc-41b5-821f-540f9d9811cc. {{(pid=86763) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.064s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-194976345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3ee164-3054-44e6-910d-ada323aebbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dccf9a41934efaa93fa59ace9c16b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:40Z,use_quota=True,user_id='5b0f564234764da1ac77e7fb36870be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Creating volume ed3ee164-3054-44e6-910d-ada323aebbfa {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:11 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa 1073741824 Sep 29 12:40:11 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7d345c34-d680-4992-8765-989441dfbc53 tempest-VolumesActionsTest-1996071789 None] Copy volume to image completed successfully. Sep 29 12:40:11 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa 1073741824" returned: 0 in 0.495s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:11 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa Sep 29 12:40:11 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:11 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.733s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc76b53e-5d08-4374-b078-f21017ded73f,created_at=2026-09-29T10:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397446676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc76b53e-5d08-4374-b078-f21017ded73f,host='devstack@QuobyteHD#QuobyteHD',id=402d8576-fb5c-4c99-879a-bd3c95ce7ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc8fd73fdf44b62a38613f461f1c476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:04Z,use_quota=True,user_id='d00be984fa5d4cc4ba684d79fec4d1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09281273-605c-4014-adc7-2e8bc58fdd3e),volume_type_id=09281273-605c-4014-adc7-2e8bc58fdd3e)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Creating volume 402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675baffc-5006-4cfe-827b-d9ffaf2c8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3ee164-3054-44e6-910d-ada323aebbfa', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd06f4a-1f8e-4fbf-9b86-7beb98a5d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:12 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 1073741824 Sep 29 12:40:12 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Volume volume-ed3ee164-3054-44e6-910d-ada323aebbfa (ed3ee164-3054-44e6-910d-ada323aebbfa): created successfully Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd06f4a-1f8e-4fbf-9b86-7beb98a5d604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Flow 'volume_create_manager' (2adb51b1-8624-4216-8784-76de06ad990e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-37555c96-94f4-4124-866c-e043b825c470 tempest-VolumesTransfersTest-1313316371 None] Created volume successfully. Sep 29 12:40:12 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 1073741824" returned: 0 in 0.517s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:12 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 Sep 29 12:40:12 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:12 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.086s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341769444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e982ee3-49be-4e88-9e2b-5f19c7096e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:11Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Creating volume 2e982ee3-49be-4e88-9e2b-5f19c7096e5a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c68ad4c-38ff-4e2b-87f5-b37740f12147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8ed51d-8805-4753-8eee-2181dad08016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:12 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a 1073741824 Sep 29 12:40:12 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:13 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a 1073741824" returned: 0 in 0.526s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Volume volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 (402d8576-fb5c-4c99-879a-bd3c95ce7ac1): created successfully Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8ed51d-8805-4753-8eee-2181dad08016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Flow 'volume_create_manager' (0ed17e98-3575-4715-a78c-d0e3a68fca3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c8a5075e-94f2-4eb9-8383-a2644d021278 tempest-GroupSnapshotsV319Test-804615435 None] Created volume successfully. Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:13 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a Sep 29 12:40:13 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:13 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cbb3f0-3a8e-4c1e-af6d-6ace5abf6272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30038bc-9a6b-4553-ba0a-21f390d578c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f497935-5728-408a-b9d3-52b537185046]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Volume volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a (2e982ee3-49be-4e88-9e2b-5f19c7096e5a): created successfully Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30038bc-9a6b-4553-ba0a-21f390d578c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (042a9866-d003-44ee-b317-976487b2eab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1cb1e30-58a3-446b-9d37-5e864ef00f23 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:14 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:40:14 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] GroupSnapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: creating. Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Group snapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:14 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.552s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c0145-6769-4827-b8c8-372e7c2ea3d9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4db87fec-61cc-4971-8838-4f4390f94271 tempest-VolumesTransfersTest-1560204755 None] Transfer volume completed successfully. Sep 29 12:40:14 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:40:14 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f63efbb6-ed3d-4f6c-ae73-592003b66bd8 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f63efbb6-ed3d-4f6c-ae73-592003b66bd8 tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" acquired by "attach_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f63efbb6-ed3d-4f6c-ae73-592003b66bd8 tempest-VolumesActionsTest-1028679694 None] Attaching volume 2e982ee3-49be-4e88-9e2b-5f19c7096e5a to instance 38f8eb9e-b61d-4568-aa50-c47c0c844f77 at mountpoint /dev/vdb on host None. Sep 29 12:40:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f63efbb6-ed3d-4f6c-ae73-592003b66bd8 tempest-VolumesActionsTest-1028679694 None] Attach volume completed successfully. Sep 29 12:40:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f63efbb6-ed3d-4f6c-ae73-592003b66bd8 tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" released by "attach_volume" :: held 0.164s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:15 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.690s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:15 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img Sep 29 12:40:15 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Acquiring lock "cinder-ed3ee164-3054-44e6-910d-ada323aebbfa-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "cinder-ed3ee164-3054-44e6-910d-ada323aebbfa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Acquiring lock "cinder-quobyte-ed3ee164-3054-44e6-910d-ada323aebbfa" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "cinder-quobyte-ed3ee164-3054-44e6-910d-ada323aebbfa" acquired by "delete_volume" :: waited 0.056s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f027d-7254-49d4-8b70-59cb3e61e15f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Terminate volume connection completed successfully. Sep 29 12:40:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Detaching volume 2e982ee3-49be-4e88-9e2b-5f19c7096e5a from instance 38f8eb9e-b61d-4568-aa50-c47c0c844f77. Sep 29 12:40:16 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa Sep 29 12:40:16 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Detach volume completed successfully. Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1c81558-9b8e-45b4-af92-afeef90f51c6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c4b83b3-18c7-4b43-a3d0-6cf6d496e482 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c4b83b3-18c7-4b43-a3d0-6cf6d496e482 tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0c4b83b3-18c7-4b43-a3d0-6cf6d496e482 tempest-VolumesActionsTest-1028679694 None] Volume detach called, but volume not attached. Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c4b83b3-18c7-4b43-a3d0-6cf6d496e482 tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:16 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa" returned: 0 in 1.209s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:17 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa Sep 29 12:40:17 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-quobyte-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "cinder-quobyte-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" acquired by "delete_volume" :: waited 0.077s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e12aa24-8a1e-4a47-b232-133bb4809cbe]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:17 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ed3ee164-3054-44e6-910d-ada323aebbfa" returned: 0 in 0.561s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "cinder-quobyte-ed3ee164-3054-44e6-910d-ada323aebbfa" released by "delete_volume" :: held 1.912s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:17 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a Sep 29 12:40:17 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Created reservations ['ab56722f-d41d-4f8b-83fa-5e3fb326c90b', '4ec5f6a3-d3f4-4d3f-a4ff-03c639bfcebb', '5be43b0b-58fc-4a5f-ad13-3300ebf0a577', 'ce5862c9-cbfe-4812-9540-7331a3ca4d51'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:18 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:18 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:18 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" returned: 0 in 1.148s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:18 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a Sep 29 12:40:18 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:18 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.773s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Deleted volume successfully. Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59aa43d2-8903-4ac8-a5d6-4933e1914de5 tempest-VolumesTransfersTest-913373031 None] Lock "cinder-ed3ee164-3054-44e6-910d-ada323aebbfa-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:19 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "cinder-quobyte-2e982ee3-49be-4e88-9e2b-5f19c7096e5a" released by "delete_volume" :: held 2.131s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Created reservations ['d2d258c4-7810-4ec6-af6d-1e06ef788ce9', 'aa3c9201-c10e-477a-8575-3f8c6dd27852', 'cd4a8437-7773-4137-8bc3-651223358b5d', '8ee06e0f-5453-4eda-8fbb-06a1edd25023'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:19 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:19 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:20 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.641s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Deleted volume successfully. Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Flow 'volume_create_manager' (79eb6bd3-ed81-474b-9806-ed08cef36cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc22a9d-357b-4762-b786-affd02f69fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e92823a2-f04f-42f7-9363-c179c6e31e8c tempest-VolumesActionsTest-1028679694 None] Lock "cinder-2e982ee3-49be-4e88-9e2b-5f19c7096e5a-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc22a9d-357b-4762-b786-affd02f69fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1276814422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905528e3-6d2e-45d9-acfb-44844fe2e457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dccf9a41934efaa93fa59ace9c16b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:20Z,use_quota=True,user_id='5b0f564234764da1ac77e7fb36870be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19288ba6-74d2-4796-a1d6-8ba99bb899d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19288ba6-74d2-4796-a1d6-8ba99bb899d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d42c2-5794-4a19-a675-370e57216307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d42c2-5794-4a19-a675-370e57216307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905528e3-6d2e-45d9-acfb-44844fe2e457', 'volume_name': 'volume-905528e3-6d2e-45d9-acfb-44844fe2e457', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba72e68-d2b9-4ef1-a5ef-d582de513012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba72e68-d2b9-4ef1-a5ef-d582de513012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b66e1b-817c-4288-ab69-48d06979238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Volume 905528e3-6d2e-45d9-acfb-44844fe2e457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905528e3-6d2e-45d9-acfb-44844fe2e457', 'volume_size': 1} Sep 29 12:40:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:24 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img" returned: 0 in 9.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba18a2-b892-4120-98e0-12050561c3ca]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:24 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:40:24 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:25 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:40:25 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Converted 1024.00 MB image at 108.26 MB/s Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] e7e8b3f8-7549-4ecb-9103-6f7ff3823b8f was raw, converting to qcow2 {{(pid=86763) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e9097-c1e9-4f58-b766-25f7dc740438]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:25 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img Sep 29 12:40:25 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:25 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img" returned: 0 in 0.334s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:25 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img Sep 29 12:40:25 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:25 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img" returned: 1 in 0.318s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:40:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img /opt/stack/data/cinder/conversion/vol_upload_8_7820uw {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:25 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img /opt/stack/data/cinder/conversion/vol_upload_8_7820uw Sep 29 12:40:25 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (6f2b8f6c-211c-44d6-91a6-115e03c320bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2490fbc3-0cec-40e2-a470-61a625278520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2490fbc3-0cec-40e2-a470-61a625278520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318975120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec898692-329f-4408-8e61-df8056a5aa22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:26Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8867ce5-cacf-4807-9b73-68ff07cbb862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8867ce5-cacf-4807-9b73-68ff07cbb862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149e8529-7991-4c1b-bc35-597b83c93fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149e8529-7991-4c1b-bc35-597b83c93fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec898692-329f-4408-8e61-df8056a5aa22', 'volume_name': 'volume-ec898692-329f-4408-8e61-df8056a5aa22', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6816257-2cfc-44d1-983e-0b0ed848ae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6816257-2cfc-44d1-983e-0b0ed848ae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6549c9b0-6280-460c-a548-b4c846718316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Volume ec898692-329f-4408-8e61-df8056a5aa22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec898692-329f-4408-8e61-df8056a5aa22', 'volume_size': 1} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:26 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img /opt/stack/data/cinder/conversion/vol_upload_8_7820uw" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Image conversion details: src /opt/stack/data/cinder/conversion/a7413366-d296-4e1a-a77c-6867513cf0b7.temp_image.e7e8b3f8-7549-4ecb-9103-6f7ff3823b8fj7phwqjo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8_7820uw {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:40:26 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b16b9-9f43-4377-93d4-c6031f1559f3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_7820uw {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:26 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_7820uw Sep 29 12:40:26 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:26 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_7820uw" returned: 0 in 0.336s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.078s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Uploaded volume to glance image-id: e7e8b3f8-7549-4ecb-9103-6f7ff3823b8f. {{(pid=86763) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:40:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.521s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Creating offline snapshot 20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a of volume 402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:40:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2a48033d-a542-441c-8479-16c982f1d804 tempest-VolumesActionsTest-1996071789 None] Copy volume to image completed successfully. Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553a027-1158-4b0d-8064-ddb17d4c2afc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:28 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 Sep 29 12:40:28 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:28 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" returned: 0 in 0.356s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:28 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a 1G Sep 29 12:40:28 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:28 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a 1G" returned: 0 in 0.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:28 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a Sep 29 12:40:28 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:29 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:29 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a Sep 29 12:40:29 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:29 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:29 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info Sep 29 12:40:29 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:29 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info" returned: 0 in 0.290s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:29 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info Sep 29 12:40:29 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "cinder-quobyte-a7413366-d296-4e1a-a77c-6867513cf0b7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-quobyte-a7413366-d296-4e1a-a77c-6867513cf0b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1cfe16-e613-496b-8646-50221f3197ed]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:29 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.info" returned: 0 in 0.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.314s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1276814422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905528e3-6d2e-45d9-acfb-44844fe2e457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dccf9a41934efaa93fa59ace9c16b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:20Z,use_quota=True,user_id='5b0f564234764da1ac77e7fb36870be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Creating volume 905528e3-6d2e-45d9-acfb-44844fe2e457 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:30 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 1073741824 Sep 29 12:40:30 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:40:30 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:40:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-028d1e2f-b59a-4654-8aa1-0ffb3152bf31 tempest-GroupSnapshotsV319Test-804615435 None] group_snapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: created successfully Sep 29 12:40:30 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:30 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7 Sep 29 12:40:30 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 1073741824" returned: 0 in 0.506s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:30 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 Sep 29 12:40:30 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a7413366-d296-4e1a-a77c-6867513cf0b7" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-quobyte-a7413366-d296-4e1a-a77c-6867513cf0b7" released by "delete_volume" :: held 0.732s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Created reservations ['c33807ff-516c-43f6-969b-0101332a4b8f', 'dfe3c15a-36be-4a43-9144-f98120d69b42', 'dd8b5caf-e205-471a-bb1f-2390faded97e', '55e77573-f463-446f-b0e0-947d87b7d3c0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:30 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:30 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457" returned: 0 in 0.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.654s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318975120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec898692-329f-4408-8e61-df8056a5aa22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:26Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Creating volume ec898692-329f-4408-8e61-df8056a5aa22 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b66e1b-817c-4288-ab69-48d06979238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905528e3-6d2e-45d9-acfb-44844fe2e457', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4d8faa-7d09-4c69-bcf2-de49939a8d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:30 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 1073741824 Sep 29 12:40:30 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] group_snapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: deleting Sep 29 12:40:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Volume volume-905528e3-6d2e-45d9-acfb-44844fe2e457 (905528e3-6d2e-45d9-acfb-44844fe2e457): created successfully Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4d8faa-7d09-4c69-bcf2-de49939a8d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Flow 'volume_create_manager' (79eb6bd3-ed81-474b-9806-ed08cef36cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e6d15896-d648-4047-bc56-8e4bf583ddd2 tempest-VolumesTransfersTest-1313316371 None] Created volume successfully. Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] group_snapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "cinder-quobyte-20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Deleting offline snapshot 20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a of volume 402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] snapshot_file for this snap is: volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:40:31 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f69eca-663a-49ad-90f0-ed137b7408a3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Deleted volume successfully. Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e29ef7ea-88d2-489a-a56f-a16e78bfdee9 tempest-VolumesActionsTest-1996071789 None] Lock "cinder-a7413366-d296-4e1a-a77c-6867513cf0b7-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:31 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a Sep 29 12:40:31 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:31 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 1073741824" returned: 0 in 0.654s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:31 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:31 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" returned: 0 in 0.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:40:31 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a176aac-e930-45a9-bc93-f6d7bdb34345]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:31 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 Sep 29 12:40:31 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:31 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22" returned: 0 in 0.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6549c9b0-6280-460c-a548-b4c846718316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec898692-329f-4408-8e61-df8056a5aa22', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfaebd6-a4e9-4874-860e-71441f1c94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Volume volume-ec898692-329f-4408-8e61-df8056a5aa22 (ec898692-329f-4408-8e61-df8056a5aa22): created successfully Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfaebd6-a4e9-4874-860e-71441f1c94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (6f2b8f6c-211c-44d6-91a6-115e03c320bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0ab9c172-ec92-463c-abdf-833803c31a49 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:32 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" returned: 0 in 0.490s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:32 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a Sep 29 12:40:32 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Acquiring lock "cinder-905528e3-6d2e-45d9-acfb-44844fe2e457-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "cinder-905528e3-6d2e-45d9-acfb-44844fe2e457-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Acquiring lock "cinder-quobyte-905528e3-6d2e-45d9-acfb-44844fe2e457" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "cinder-quobyte-905528e3-6d2e-45d9-acfb-44844fe2e457" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8aee1-b956-4c24-886b-e69ff9901569]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:32 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 Sep 29 12:40:32 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:32 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" returned: 0 in 0.488s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:32 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a Sep 29 12:40:32 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:32 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457" returned: 0 in 0.470s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-ec898692-329f-4408-8e61-df8056a5aa22-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:32 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457 Sep 29 12:40:32 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "cinder-ec898692-329f-4408-8e61-df8056a5aa22-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:33 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1.20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" returned: 0 in 0.368s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-20840eeb-2ccf-4c4f-9b79-70ae05d7fb3a" released by "_delete_snapshot" :: held 1.964s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" released by "delete_snapshot" :: held 1.999s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:33 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-905528e3-6d2e-45d9-acfb-44844fe2e457" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "cinder-quobyte-905528e3-6d2e-45d9-acfb-44844fe2e457" released by "delete_volume" :: held 0.831s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-quobyte-ec898692-329f-4408-8e61-df8056a5aa22" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Created reservations ['e5088e7f-e8e9-4366-8800-0e6d061207bb', '2e95e44c-e927-42b1-bfea-94d724408767', '29433dc0-db18-4450-9ea9-c92c22610c97', 'f0a7417a-3daa-4810-88b3-67071319a3dd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-ec898692-329f-4408-8e61-df8056a5aa22" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7775213-171a-4f4e-bf72-55098a19215d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:33 devstack cinder-volume[86763]: WARNING cinder.quota [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1199572084 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1199572084, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:40:33 devstack cinder-volume[86763]: WARNING cinder.quota [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1199572084 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1199572084, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:40:33 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 Sep 29 12:40:33 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:33 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:33 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] Created reservations ['39249861-94cc-45ed-a9b6-c5967a4191b1', '43d8fac3-7e3b-4f40-93a9-3fa61dfed120', '255f53ca-04ed-4165-bb5e-84a33e0c4f8c', '719fe553-2ff9-476e-8681-2cfa33ee47c5'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:33 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.262s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Deleted volume successfully. Sep 29 12:40:33 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22" returned: 0 in 0.436s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:33 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22 Sep 29 12:40:33 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:34 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ec898692-329f-4408-8e61-df8056a5aa22" returned: 0 in 0.273s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-ec898692-329f-4408-8e61-df8056a5aa22" released by "delete_volume" :: held 0.767s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c04b8069-63db-47af-9c1a-b000be8a6f3d tempest-VolumesTransfersTest-913373031 None] Lock "cinder-905528e3-6d2e-45d9-acfb-44844fe2e457-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Created reservations ['c6d97a66-b494-4f0b-9504-51690df6a4ed', 'b754f199-2dc5-489a-b962-6c7e99ade789', '794fdd3d-e02b-4f5c-9fac-874a55d69695', '84caaed5-a33c-4e2b-b12f-1af797551e68'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7dcac800-fb60-496e-aa8c-ce386b8dfef8 tempest-GroupSnapshotsV319Test-804615435 None] group_snapshot d4fac1f1-af60-45d5-8e1f-c20b23d8ca4e: deleted successfully Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:34 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:34 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:34 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Deleted volume successfully. Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2c403-2007-4c37-a325-55df12c9f016]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abe8d9da-4d59-40fe-b3be-0c7da890f7ce tempest-VolumesActionsTest-1783120634 None] Lock "cinder-ec898692-329f-4408-8e61-df8056a5aa22-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:35 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 Sep 29 12:40:35 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:35 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:35 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1 Sep 29 12:40:35 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:35 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "cinder-quobyte-402d8576-fb5c-4c99-879a-bd3c95ce7ac1" released by "delete_volume" :: held 0.755s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:38 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Created reservations ['e83b2716-1988-4503-8621-300dd53e618f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:39 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1199572084 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1199572084, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Created reservations ['0527fa8c-aa27-4520-bc89-ca74ac7b72e3', '0466bba6-e4a7-4fab-9b39-6385464dbf10', 'cbdd7b1d-bff5-4466-aff0-f4fb5c705f4a', '91f174d3-f387-4295-9b29-19e643472107'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (fe29bcc3-64b7-46dc-a2c0-542e15c52638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12427d7-4680-40e9-a4df-700aa2bbc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12427d7-4680-40e9-a4df-700aa2bbc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-236180203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ffcede-d9da-4496-a20d-77e719c24b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:39Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445a26a1-cdae-4312-a8a0-b28c8052068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445a26a1-cdae-4312-a8a0-b28c8052068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a89e6-956d-4793-86f8-2e4d85d83615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a89e6-956d-4793-86f8-2e4d85d83615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ffcede-d9da-4496-a20d-77e719c24b2e', 'volume_name': 'volume-66ffcede-d9da-4496-a20d-77e719c24b2e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0791f3-dae3-431a-9f9d-b71c6609b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b0791f3-dae3-431a-9f9d-b71c6609b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5486188e-5735-4fd1-b7ea-62140ae61906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Volume 66ffcede-d9da-4496-a20d-77e719c24b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ffcede-d9da-4496-a20d-77e719c24b2e', 'volume_size': 1} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-236180203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ffcede-d9da-4496-a20d-77e719c24b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:39Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Creating volume 66ffcede-d9da-4496-a20d-77e719c24b2e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:39 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e 1073741824 Sep 29 12:40:39 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:39 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:39 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:39 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:39 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c45f0280-7584-4e9e-afc6-0b940faf6dd8 tempest-GroupSnapshotsV319Test-804615435 None] Delete group completed successfully. Sep 29 12:40:40 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e 1073741824" returned: 0 in 0.726s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:40 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e Sep 29 12:40:40 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:40 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e" returned: 0 in 0.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5486188e-5735-4fd1-b7ea-62140ae61906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ffcede-d9da-4496-a20d-77e719c24b2e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a437e9-467e-4aed-a384-7d1f2955081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Volume volume-66ffcede-d9da-4496-a20d-77e719c24b2e (66ffcede-d9da-4496-a20d-77e719c24b2e): created successfully Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a437e9-467e-4aed-a384-7d1f2955081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (fe29bcc3-64b7-46dc-a2c0-542e15c52638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-62b26c6c-3bfa-4861-a05b-b528acbb6605 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-66ffcede-d9da-4496-a20d-77e719c24b2e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-66ffcede-d9da-4496-a20d-77e719c24b2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-quobyte-66ffcede-d9da-4496-a20d-77e719c24b2e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-66ffcede-d9da-4496-a20d-77e719c24b2e" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff44932c-ea5a-47e1-a14e-c46bad9243bb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:41 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e Sep 29 12:40:41 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:42 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e" returned: 0 in 0.511s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:42 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e Sep 29 12:40:42 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:42 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-66ffcede-d9da-4496-a20d-77e719c24b2e" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-66ffcede-d9da-4496-a20d-77e719c24b2e" released by "delete_volume" :: held 0.869s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Created reservations ['aee8155d-bc16-4daf-9a96-4c2e082bd2ae', 'd147f71d-16fc-4710-be5c-ee0fbd0a2bd0', '250e3c5c-1d30-4af3-8062-7c34b7e58598', 'eec2b816-7451-48d5-b040-44ec3eed55ff'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:42 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:42 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:42 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:42 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Deleted volume successfully. Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-39ee9cb1-09fa-4cb4-a6d8-f6b59afca3f1 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-66ffcede-d9da-4496-a20d-77e719c24b2e-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (52e7fcba-ec25-4615-99b7-e0ca3bcfc0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1768ec-99f8-44d7-b760-b1239fcd6405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1768ec-99f8-44d7-b760-b1239fcd6405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1801558215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b42a560-4d95-42c1-9ecc-1ee1c22a06a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:43Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470e9b1-a661-4c46-a917-bb557f0e4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470e9b1-a661-4c46-a917-bb557f0e4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6a50ea-d375-4679-bbaf-e7e8c8900d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6a50ea-d375-4679-bbaf-e7e8c8900d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b42a560-4d95-42c1-9ecc-1ee1c22a06a1', 'volume_name': 'volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baec4736-de6e-4612-ac5f-bd8d0f4b5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baec4736-de6e-4612-ac5f-bd8d0f4b5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2041f1f5-c789-4526-b292-573db8eedb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Volume 7b42a560-4d95-42c1-9ecc-1ee1c22a06a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1', 'volume_size': 1} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1801558215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b42a560-4d95-42c1-9ecc-1ee1c22a06a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:43Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Creating volume 7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:43 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:43 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 1073741824 Sep 29 12:40:43 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:44 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 1073741824" returned: 0 in 0.646s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:44 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 Sep 29 12:40:44 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:44 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" returned: 0 in 0.287s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2041f1f5-c789-4526-b292-573db8eedb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a033fa2-d9fe-4eb6-b17c-096a209c37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Volume volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 (7b42a560-4d95-42c1-9ecc-1ee1c22a06a1): created successfully Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a033fa2-d9fe-4eb6-b17c-096a209c37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (52e7fcba-ec25-4615-99b7-e0ca3bcfc0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e04c1c33-3e9f-44f1-8f40-b9401cbea977 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Flow 'volume_create_manager' (7982223f-0b6e-4885-8f9c-cd6dfff2782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646b0cf1-d848-4ef6-bc7f-a3ac433c5885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646b0cf1-d848-4ef6-bc7f-a3ac433c5885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1844130796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012ab09a-86df-444b-8d0b-946d3be09717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b301a11a574359bfbb9e48255e3171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:46Z,use_quota=True,user_id='2d28dc828b8440db84fedbc912918503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54202bc-b28f-406a-8482-8177e4411991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54202bc-b28f-406a-8482-8177e4411991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457058b8-8be2-4ce4-895c-2fbfe600e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "cinder-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-quobyte-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe6e48-7389-447a-831a-0fb342190e84]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:46 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 Sep 29 12:40:46 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:46 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" returned: 0 in 0.444s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:46 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1 Sep 29 12:40:46 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457058b8-8be2-4ce4-895c-2fbfe600e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '012ab09a-86df-444b-8d0b-946d3be09717', 'volume_name': 'volume-012ab09a-86df-444b-8d0b-946d3be09717', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127a6498-ce4e-4b5c-83fe-b2b0f8e5818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127a6498-ce4e-4b5c-83fe-b2b0f8e5818a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa7b25f-ef9d-4f2d-bdb5-5e9419491882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Volume 012ab09a-86df-444b-8d0b-946d3be09717: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-012ab09a-86df-444b-8d0b-946d3be09717', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Trying to clone 012ab09a-86df-444b-8d0b-946d3be09717 from image 94feb733-57cd-4052-a12a-6ab2ace34da5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:40:46 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1" released by "delete_volume" :: held 0.875s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:46 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Created reservations ['8ba67fc5-699d-4204-a307-91d4a7ca4ad1', '70425760-24c7-46a3-b60e-93d01c9a1e43', 'd8bd1db4-48ed-414a-a234-7230faf553ad', 'af92b2bf-5c01-4df6-a6af-3faf161c2ee2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:47 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:47 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:40:47 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca190d89-6ccf-4edf-935e-bbb57299d7ea]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:47 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Deleted volume successfully. Sep 29 12:40:47 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD Sep 29 12:40:47 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-18d6818f-cfd7-4cd8-9ca6-fb1958a57e7a tempest-VolumesActionsTest-1783120634 None] Lock "cinder-7b42a560-4d95-42c1-9ecc-1ee1c22a06a1-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:47 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 is fetched for user 2d28dc828b8440db84fedbc912918503. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfd69b-a419-4228-9525-febe798a4b6a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Flow 'volume_create_manager' (add3d3a4-c270-4bf2-8d3c-cf968219640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377ca246-c74b-4cb3-ab8b-2af1944cb4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377ca246-c74b-4cb3-ab8b-2af1944cb4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1734370442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6d59-5552-485f-90b9-297ed0855dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b954f306ecf84163a77e6fd60ef11f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:48Z,use_quota=True,user_id='3fa2340a4df44147ab85dafbfdc22650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1f060c-e2f1-4fb2-b26d-8d3e7ede0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1f060c-e2f1-4fb2-b26d-8d3e7ede0e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da5d343-0333-482f-80ad-d14bfc5bb1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da5d343-0333-482f-80ad-d14bfc5bb1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921f6d59-5552-485f-90b9-297ed0855dff', 'volume_name': 'volume-921f6d59-5552-485f-90b9-297ed0855dff', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD Sep 29 12:40:48 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740278ce-bd5d-412c-9d42-5c75e345c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740278ce-bd5d-412c-9d42-5c75e345c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7ad85-091c-49ea-960b-24e4d57aba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Volume 921f6d59-5552-485f-90b9-297ed0855dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921f6d59-5552-485f-90b9-297ed0855dff', 'volume_size': 2} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1734370442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6d59-5552-485f-90b9-297ed0855dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b954f306ecf84163a77e6fd60ef11f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:48Z,use_quota=True,user_id='3fa2340a4df44147ab85dafbfdc22650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Creating volume 921f6d59-5552-485f-90b9-297ed0855dff {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff 2147483648 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:48 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff 2147483648 Sep 29 12:40:48 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:48 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (fee8a22c-b744-4266-9c5e-07dd5006fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ab631a-2a4d-4c6d-ac0e-9ae7a8952ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bdab4afc-00b9-447e-a5fe-cbf2763b68a6 tempest-GroupsV320Test-1420188334 None] Group tempest-GroupsV320Test-Group-102703629: creating Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ab631a-2a4d-4c6d-ac0e-9ae7a8952ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735943886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38e3825-2571-477f-8853-c49a93effde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:49Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f8ad16-0947-454c-81a9-7e96d8bc3383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f8ad16-0947-454c-81a9-7e96d8bc3383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6de5a6-7098-4a06-a20c-2bdda4aa5ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6de5a6-7098-4a06-a20c-2bdda4aa5ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38e3825-2571-477f-8853-c49a93effde2', 'volume_name': 'volume-d38e3825-2571-477f-8853-c49a93effde2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04caf700-b0c1-455f-a4ea-b0e8a0c3c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04caf700-b0c1-455f-a4ea-b0e8a0c3c70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89e965f-b96b-454d-a6f1-2fd158998828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Volume d38e3825-2571-477f-8853-c49a93effde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38e3825-2571-477f-8853-c49a93effde2', 'volume_size': 1} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff 2147483648" returned: 0 in 0.732s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bdab4afc-00b9-447e-a5fe-cbf2763b68a6 tempest-GroupsV320Test-1420188334 None] Group tempest-GroupsV320Test-Group-102703629: created successfully Sep 29 12:40:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bdab4afc-00b9-447e-a5fe-cbf2763b68a6 tempest-GroupsV320Test-1420188334 None] Create group completed successfully. Sep 29 12:40:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:48 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff Sep 29 12:40:48 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:49 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff" returned: 0 in 0.279s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1844130796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012ab09a-86df-444b-8d0b-946d3be09717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b301a11a574359bfbb9e48255e3171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:46Z,use_quota=True,user_id='2d28dc828b8440db84fedbc912918503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Creating volume 012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:49 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7ad85-091c-49ea-960b-24e4d57aba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921f6d59-5552-485f-90b9-297ed0855dff', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7710a2f6-4ee8-441a-a420-8c32828a7b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:49 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1073741824 Sep 29 12:40:49 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Volume volume-921f6d59-5552-485f-90b9-297ed0855dff (921f6d59-5552-485f-90b9-297ed0855dff): created successfully Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7710a2f6-4ee8-441a-a420-8c32828a7b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Flow 'volume_create_manager' (add3d3a4-c270-4bf2-8d3c-cf968219640f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7b01f627-b9a0-4129-8385-632326826fb5 tempest-VolumesCloneNegativeTest-1526916015 None] Created volume successfully. Sep 29 12:40:49 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1073741824" returned: 0 in 0.463s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:49 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 Sep 29 12:40:49 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735943886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38e3825-2571-477f-8853-c49a93effde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:49Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Creating volume d38e3825-2571-477f-8853-c49a93effde2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:50 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 1073741824 Sep 29 12:40:50 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Attempting download of 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 012ab09a-86df-444b-8d0b-946d3be09717. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4752649-d2ac-4def-b0dd-d348f0182588]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Acquiring lock "cinder-921f6d59-5552-485f-90b9-297ed0855dff-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:50 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79 Sep 29 12:40:50 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "cinder-921f6d59-5552-485f-90b9-297ed0855dff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Acquiring lock "cinder-quobyte-921f6d59-5552-485f-90b9-297ed0855dff" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "cinder-quobyte-921f6d59-5552-485f-90b9-297ed0855dff" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18050be-2a95-43b2-afae-6be96df035d1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Created reservations ['552eccc8-0502-4008-a354-fae202ba9ced'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:50 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff Sep 29 12:40:50 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79 Sep 29 12:40:50 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:50 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:50 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 1073741824" returned: 0 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:50 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 Sep 29 12:40:50 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:51 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.302s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7b4a0a14-d3e5-45ed-93ad-884a17735dc2 tempest-GroupsV320Test-1420188334 None] Delete group completed successfully. Sep 29 12:40:51 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79" returned: 1 in 0.464s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_rw2nyn79' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5183e98-de8e-4ed2-b202-f5d2719f8770]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:51 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89e965f-b96b-454d-a6f1-2fd158998828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38e3825-2571-477f-8853-c49a93effde2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:51 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b394a23-e8c0-4025-a6b0-e6c5fc001234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff" returned: 0 in 0.645s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Volume volume-d38e3825-2571-477f-8853-c49a93effde2 (d38e3825-2571-477f-8853-c49a93effde2): created successfully Sep 29 12:40:51 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff Sep 29 12:40:51 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b394a23-e8c0-4025-a6b0-e6c5fc001234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (fee8a22c-b744-4266-9c5e-07dd5006fe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d378d983-c455-4454-a52c-82cf0ee3f922 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:51 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD Sep 29 12:40:51 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:51 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-921f6d59-5552-485f-90b9-297ed0855dff" returned: 0 in 0.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "cinder-quobyte-921f6d59-5552-485f-90b9-297ed0855dff" released by "delete_volume" :: held 0.964s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:51 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] 94feb733-57cd-4052-a12a-6ab2ace34da5 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Created reservations ['31237b70-0c17-4f17-b7a4-f947b6d2b05c', '9e4547d2-249d-4410-8922-efd33b22e564', '4e6b7005-146c-40a1-be51-773416afa595', '24d43855-8122-45f1-8549-401f5b4894ca'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:51 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 Sep 29 12:40:51 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:51 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:51 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:51 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.287s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Deleted volume successfully. Sep 29 12:40:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec3c87c5-a671-431c-8dfb-6a19e29cb431 tempest-VolumesCloneNegativeTest-1526916015 None] Lock "cinder-921f6d59-5552-485f-90b9-297ed0855dff-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-d38e3825-2571-477f-8853-c49a93effde2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-d38e3825-2571-477f-8853-c49a93effde2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "cinder-quobyte-d38e3825-2571-477f-8853-c49a93effde2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-d38e3825-2571-477f-8853-c49a93effde2" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e747254c-b008-4dfc-8fcb-d380dacd3410]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:52 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 Sep 29 12:40:52 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:52 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2" returned: 0 in 0.499s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:52 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2 Sep 29 12:40:52 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:52 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d38e3825-2571-477f-8853-c49a93effde2" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-quobyte-d38e3825-2571-477f-8853-c49a93effde2" released by "delete_volume" :: held 0.863s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Created reservations ['a8ba34f4-8802-40a8-8eeb-76fec95dc9cb', 'd62fb068-460d-44ca-b4d6-ef32c9830169', 'f5d57af6-e43f-4df8-bca2-5046721d9440', '8410ae86-c938-4492-ad4a-081697c0ebc2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:53 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:53 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:53 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.455s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Deleted volume successfully. Sep 29 12:40:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6e0ecd1-21d4-45af-968a-403137d49ee6 tempest-VolumesActionsTest-1783120634 None] Lock "cinder-d38e3825-2571-477f-8853-c49a93effde2-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:54 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717" returned: 0 in 2.569s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_ew1__7lydevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:40:54 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Converted 112.00 MB image at 43.58 MB/s Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:54 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1G Sep 29 12:40:54 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (21b0feeb-cf76-4a96-9200-ea237e3fff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38534255-1ede-4047-9609-00fd595d4334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38534255-1ede-4047-9609-00fd595d4334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-968128239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffead20-86b5-43a5-8fba-2ec5e74c8108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:54Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4593f2a0-c065-4785-85d2-b5fa14377fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4593f2a0-c065-4785-85d2-b5fa14377fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d91a7c0-5382-4d60-8a00-3f44d00af13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d91a7c0-5382-4d60-8a00-3f44d00af13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffead20-86b5-43a5-8fba-2ec5e74c8108', 'volume_name': 'volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baa0dfa-6d89-4535-8a06-ccb1c3ee261c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baa0dfa-6d89-4535-8a06-ccb1c3ee261c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a86e26-affc-44c7-a17a-aeeefecc8be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Volume 4ffead20-86b5-43a5-8fba-2ec5e74c8108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108', 'volume_size': 1} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-968128239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffead20-86b5-43a5-8fba-2ec5e74c8108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37dc9b4fa14e0fbb8fd193e6c754eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:54Z,use_quota=True,user_id='b1a4b1a841b74a88a5b8859f9ac0dc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Creating volume 4ffead20-86b5-43a5-8fba-2ec5e74c8108 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:40:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:54 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 1073741824 Sep 29 12:40:54 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:54 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 1G" returned: 0 in 0.395s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Downloaded image 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 012ab09a-86df-444b-8d0b-946d3be09717 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 for user 2d28dc828b8440db84fedbc912918503 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Marking volume 012ab09a-86df-444b-8d0b-946d3be09717 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Copying metadata from image 94feb733-57cd-4052-a12a-6ab2ace34da5 to 012ab09a-86df-444b-8d0b-946d3be09717. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Creating volume glance metadata for volume 012ab09a-86df-444b-8d0b-946d3be09717 backed by image 94feb733-57cd-4052-a12a-6ab2ace34da5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa7b25f-ef9d-4f2d-bdb5-5e9419491882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012ab09a-86df-444b-8d0b-946d3be09717', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba19170f-7ccf-4f8f-b264-60114a66f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Volume volume-012ab09a-86df-444b-8d0b-946d3be09717 (012ab09a-86df-444b-8d0b-946d3be09717): created successfully Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba19170f-7ccf-4f8f-b264-60114a66f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Flow 'volume_create_manager' (7982223f-0b6e-4885-8f9c-cd6dfff2782b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3d351b90-d108-495c-a77d-916bfcb4482e tempest-VolumesExtendTest-329116544 None] Created volume successfully. Sep 29 12:40:54 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 1073741824" returned: 0 in 0.602s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:54 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 Sep 29 12:40:54 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:55 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a86e26-affc-44c7-a17a-aeeefecc8be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ee69d0-e19c-4a29-9cb9-566bb89c0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:40:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Volume volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 (4ffead20-86b5-43a5-8fba-2ec5e74c8108): created successfully Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ee69d0-e19c-4a29-9cb9-566bb89c0630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Flow 'volume_create_manager' (21b0feeb-cf76-4a96-9200-ea237e3fff69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:40:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-674d70a6-5582-4b5d-b480-2b3cfb0b0507 tempest-VolumesActionsTest-1028679694 None] Created volume successfully. Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[629894fe-8461-4780-bc5a-418bd5970abf]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:55 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 Sep 29 12:40:55 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:55 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 2G" returned: 0 in 0.158s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.605s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=120,cinder:UPDATE=133,cinder:DELETE=12,cinder:INSERT=35 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=109,cinder:UPDATE=136,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:40:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-71f57634-3658-4940-974c-e44947fbfc3a tempest-VolumesExtendTest-329116544 None] Extend volume completed successfully. Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-4ffead20-86b5-43a5-8fba-2ec5e74c8108-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "cinder-4ffead20-86b5-43a5-8fba-2ec5e74c8108-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Acquiring lock "cinder-quobyte-4ffead20-86b5-43a5-8fba-2ec5e74c8108" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "cinder-quobyte-4ffead20-86b5-43a5-8fba-2ec5e74c8108" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-012ab09a-86df-444b-8d0b-946d3be09717-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de0275d-1d55-4874-a9a2-bddef6c01e1d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "cinder-012ab09a-86df-444b-8d0b-946d3be09717-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-quobyte-012ab09a-86df-444b-8d0b-946d3be09717" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-012ab09a-86df-444b-8d0b-946d3be09717" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:40:57 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 Sep 29 12:40:57 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d8b36-f1eb-40e3-951f-db8f744ebaba]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:57 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 Sep 29 12:40:57 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:57 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108" returned: 0 in 0.436s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:57 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108 Sep 29 12:40:57 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:57 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717" returned: 0 in 0.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:57 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717 Sep 29 12:40:57 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:57 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4ffead20-86b5-43a5-8fba-2ec5e74c8108" returned: 0 in 0.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "cinder-quobyte-4ffead20-86b5-43a5-8fba-2ec5e74c8108" released by "delete_volume" :: held 0.837s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Created reservations ['cb43b732-fddd-4f12-9378-246f06081c6b', '0954b102-c964-4c84-bc42-6367158bcf47', '65a1ecc4-a70f-4152-be01-bcce0a35fbd8', '33e7be31-57e6-46fc-98a7-9903aeac978f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:58 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-012ab09a-86df-444b-8d0b-946d3be09717" returned: 0 in 0.310s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-012ab09a-86df-444b-8d0b-946d3be09717" released by "delete_volume" :: held 0.842s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:58 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:58 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Created reservations ['cfc9d03d-54f3-4b42-ac54-0442added0b8', 'd71f7758-93af-4787-8dce-0fbb89d8b38d', 'e26b2864-c32a-4e7b-b401-4c84624abee7', '45c75f59-25d9-49f7-a403-02ff6bf11f70'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:40:58 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:40:58 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:40:58 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.402s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Deleted volume successfully. Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7278a0e-b96d-47b3-aaba-321eff4a9eab tempest-VolumesActionsTest-1028679694 None] Lock "cinder-4ffead20-86b5-43a5-8fba-2ec5e74c8108-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:40:58 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:40:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Deleted volume successfully. Sep 29 12:40:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dda77e23-c117-409e-bf91-3955ea36a023 tempest-VolumesExtendTest-329116544 None] Lock "cinder-012ab09a-86df-444b-8d0b-946d3be09717-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Flow 'volume_create_manager' (32a2561d-ce92-4eff-ae43-952a42927084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c969358-9133-4994-b242-1ae9f71a4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c969358-9133-4994-b242-1ae9f71a4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1168978607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04a7fc-5567-47b2-bd30-3fecd679e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b301a11a574359bfbb9e48255e3171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:00Z,use_quota=True,user_id='2d28dc828b8440db84fedbc912918503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d99d8d8-2e66-48f2-be3e-eb90a9cc5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d99d8d8-2e66-48f2-be3e-eb90a9cc5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b1293-4208-461a-8963-3335ebed2b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b1293-4208-461a-8963-3335ebed2b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a04a7fc-5567-47b2-bd30-3fecd679e0a0', 'volume_name': 'volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d29d0f-0e11-4b7a-9485-2438ab4422c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d29d0f-0e11-4b7a-9485-2438ab4422c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9742cfe9-e6d6-4c33-880b-f4f2623fa661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Volume 0a04a7fc-5567-47b2-bd30-3fecd679e0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0', 'volume_size': 1} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1168978607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04a7fc-5567-47b2-bd30-3fecd679e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b301a11a574359bfbb9e48255e3171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:00Z,use_quota=True,user_id='2d28dc828b8440db84fedbc912918503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Creating volume 0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:00 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 1073741824 Sep 29 12:41:00 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Flow 'volume_create_manager' (ca5651f5-8892-45b0-b3fc-135d91876509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c4625d-e6fc-4ea2-a0a8-dc510531f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c4625d-e6fc-4ea2-a0a8-dc510531f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1016451770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a44b22-c953-4a66-a855-7a244bb9f983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f7d23b54f1498bb9d137804fc25332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:00Z,use_quota=True,user_id='49d76d6308c449cab77af4bf817c7c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e7fc6-2a3c-4eaa-ab5f-16c09769cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e7fc6-2a3c-4eaa-ab5f-16c09769cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0575ff-8507-4a6c-8e1a-3beed0bfe0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0575ff-8507-4a6c-8e1a-3beed0bfe0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a44b22-c953-4a66-a855-7a244bb9f983', 'volume_name': 'volume-51a44b22-c953-4a66-a855-7a244bb9f983', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc2df0e-3eab-4907-897a-a789c95b7d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc2df0e-3eab-4907-897a-a789c95b7d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81aa4f5-ce6a-40b4-b696-295ee97854b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Volume 51a44b22-c953-4a66-a855-7a244bb9f983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a44b22-c953-4a66-a855-7a244bb9f983', 'volume_size': 1} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:00 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 1073741824" returned: 0 in 0.539s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:00 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:00 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:01 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1016451770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a44b22-c953-4a66-a855-7a244bb9f983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f7d23b54f1498bb9d137804fc25332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:00Z,use_quota=True,user_id='49d76d6308c449cab77af4bf817c7c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Creating volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9742cfe9-e6d6-4c33-880b-f4f2623fa661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fab71f2-99bc-4911-8088-d5a862caeeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 1073741824 Sep 29 12:41:01 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Volume volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 (0a04a7fc-5567-47b2-bd30-3fecd679e0a0): created successfully Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fab71f2-99bc-4911-8088-d5a862caeeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Flow 'volume_create_manager' (32a2561d-ce92-4eff-ae43-952a42927084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ba931f0d-42cf-4203-8053-960e45282c70 tempest-VolumesExtendTest-329116544 None] Created volume successfully. Sep 29 12:41:01 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 1073741824" returned: 0 in 0.540s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:01 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 Sep 29 12:41:01 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (63b65feb-4c8d-47ee-bcbb-940d03f2c024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2555ca-beea-42ce-bf7f-c54cb6c39360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2555ca-beea-42ce-bf7f-c54cb6c39360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1451606037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d092dda-89f0-4380-9257-becc11a0fca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:02Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e1a459-6126-4c06-8d4e-ea4bb79c2f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e1a459-6126-4c06-8d4e-ea4bb79c2f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd08ebf-9e7a-4d2b-a43c-b8a769078246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd08ebf-9e7a-4d2b-a43c-b8a769078246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d092dda-89f0-4380-9257-becc11a0fca2', 'volume_name': 'volume-2d092dda-89f0-4380-9257-becc11a0fca2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f624b1-3355-4413-bab8-1ce20c3c24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f624b1-3355-4413-bab8-1ce20c3c24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611e08c2-e4de-440c-a30a-e4c0dca970b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Volume 2d092dda-89f0-4380-9257-becc11a0fca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d092dda-89f0-4380-9257-becc11a0fca2', 'volume_size': 1} Sep 29 12:41:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:02 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1451606037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d092dda-89f0-4380-9257-becc11a0fca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:02Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Creating volume 2d092dda-89f0-4380-9257-becc11a0fca2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81aa4f5-ce6a-40b4-b696-295ee97854b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a44b22-c953-4a66-a855-7a244bb9f983', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d342ddc-1da9-48e6-94c3-c0f6a7954723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:02 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 1073741824 Sep 29 12:41:02 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Volume volume-51a44b22-c953-4a66-a855-7a244bb9f983 (51a44b22-c953-4a66-a855-7a244bb9f983): created successfully Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d342ddc-1da9-48e6-94c3-c0f6a7954723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Flow 'volume_create_manager' (ca5651f5-8892-45b0-b3fc-135d91876509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3235df4a-a9b9-4811-aeca-22058ea7d0bf tempest-SnapshotsActionsTest-1724851305 None] Created volume successfully. Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:02 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 1073741824" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:02 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 Sep 29 12:41:02 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:02 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.562s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611e08c2-e4de-440c-a30a-e4c0dca970b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d092dda-89f0-4380-9257-becc11a0fca2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902b593a-56d3-4c85-8d0e-0d7185813074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Creating offline snapshot fc17815d-1018-4ad0-b56b-a53fc8df53ee of volume 0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Volume volume-2d092dda-89f0-4380-9257-becc11a0fca2 (2d092dda-89f0-4380-9257-becc11a0fca2): created successfully Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902b593a-56d3-4c85-8d0e-0d7185813074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (63b65feb-4c8d-47ee-bcbb-940d03f2c024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a823ec-f951-4eff-b83c-0f0ea23a5b81]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-acd7a20a-678a-4a8f-9cc3-73d80e85c869 tempest-VolumesListTestJSON-66025255 None] Created volume successfully. Sep 29 12:41:03 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:03 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:03 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.527s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:03 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee 1G Sep 29 12:41:03 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:03 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee 1G" returned: 0 in 0.416s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:03 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee Sep 29 12:41:03 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:04 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee" returned: 0 in 0.353s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:04 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee is being set with open permissions: ugo+rw Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:04 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee Sep 29 12:41:04 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:04 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee" returned: 0 in 0.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:04 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info Sep 29 12:41:04 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (6775538c-1f78-4bbb-ac2a-d8d0d762503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ffd80e-d813-43b4-9fa6-16f8f743df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ffd80e-d813-43b4-9fa6-16f8f743df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1015363807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f2df56-0deb-4203-9f07-8ae404366e56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:05Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60519b3-6437-46a8-a71b-54b3347768cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60519b3-6437-46a8-a71b-54b3347768cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61928b6b-9137-4030-a0ae-d4f17b36a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61928b6b-9137-4030-a0ae-d4f17b36a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f2df56-0deb-4203-9f07-8ae404366e56', 'volume_name': 'volume-14f2df56-0deb-4203-9f07-8ae404366e56', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ed7789-3664-4ff2-921b-53dbd21fda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ed7789-3664-4ff2-921b-53dbd21fda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba890f18-00c2-4857-8c9b-5769eba9cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Volume 14f2df56-0deb-4203-9f07-8ae404366e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f2df56-0deb-4203-9f07-8ae404366e56', 'volume_size': 1} Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:04 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:04 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info is being set with open permissions: ugo+rw Sep 29 12:41:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:04 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info Sep 29 12:41:04 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:05 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.info" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.672s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Creating offline snapshot 732ec7b8-b4cf-4928-b456-1f965192e63a of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-755a8be3-c95b-43e5-b789-0c2b4a861686 tempest-VolumesExtendTest-329116544 None] Create snapshot completed successfully Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b42aa-d045-4b0c-a836-821f8ac73766]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:05 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 Sep 29 12:41:05 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:05 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983" returned: 0 in 0.403s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:05 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a 1G Sep 29 12:41:05 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:05 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a 1G" returned: 0 in 0.453s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:06 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:06 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:06 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:06 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a is being set with open permissions: ugo+rw Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:06 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:06 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:06 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.225s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:06 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info Sep 29 12:41:06 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:06 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:06 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info is being set with open permissions: ugo+rw Sep 29 12:41:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:06 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info Sep 29 12:41:06 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:07 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.info" returned: 0 in 0.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.448s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1015363807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f2df56-0deb-4203-9f07-8ae404366e56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:05Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Creating volume 14f2df56-0deb-4203-9f07-8ae404366e56 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:07 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 1073741824 Sep 29 12:41:07 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bcda1772-02d9-4459-b117-f657d48f49ed tempest-SnapshotsActionsTest-1724851305 None] Create snapshot completed successfully Sep 29 12:41:07 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 1073741824" returned: 0 in 0.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:07 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 Sep 29 12:41:07 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:07 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56" returned: 0 in 0.358s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.317s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba890f18-00c2-4857-8c9b-5769eba9cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f2df56-0deb-4203-9f07-8ae404366e56', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3740ab5b-4291-4be8-96a1-cca54bfc9b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cd99f6-ead3-4eea-9518-1278bb510662]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Volume volume-14f2df56-0deb-4203-9f07-8ae404366e56 (14f2df56-0deb-4203-9f07-8ae404366e56): created successfully Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3740ab5b-4291-4be8-96a1-cca54bfc9b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (6775538c-1f78-4bbb-ac2a-d8d0d762503c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-174109b0-b78f-4ea7-b600-7cd1b4c04d5a tempest-VolumesListTestJSON-66025255 None] Created volume successfully. Sep 29 12:41:08 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:08 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:08 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.414s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee 2G" returned: 0 in 0.128s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.598s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Creating offline snapshot 2b4770d8-e704-461a-a088-3c5b92ba73b5 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd5a43f-e727-436f-8f81-7957e26bd2a9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c202b6a1-cc96-4399-9a39-4ef886edb420 tempest-VolumesExtendTest-329116544 None] Extend volume completed successfully. Sep 29 12:41:08 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:08 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:09 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-fc17815d-1018-4ad0-b56b-a53fc8df53ee-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:09 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 1G Sep 29 12:41:09 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-fc17815d-1018-4ad0-b56b-a53fc8df53ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-quobyte-fc17815d-1018-4ad0-b56b-a53fc8df53ee" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-fc17815d-1018-4ad0-b56b-a53fc8df53ee" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Deleting offline snapshot fc17815d-1018-4ad0-b56b-a53fc8df53ee of volume 0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] snapshot_file for this snap is: volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a808bb31-1d72-45b9-8bd5-836890c2b112]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:09 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee Sep 29 12:41:09 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (d6560774-d8b3-440e-abdc-540410c439d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92677ef7-96cf-463e-8a44-bd49ad782841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92677ef7-96cf-463e-8a44-bd49ad782841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562357292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef01faa-1d6b-4b97-9312-64f35a618c55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:10Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6dafda-7732-4968-8f7b-93ab202a3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6dafda-7732-4968-8f7b-93ab202a3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d63519c-e366-41dd-8f31-d75b6bda8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:09 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d63519c-e366-41dd-8f31-d75b6bda8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef01faa-1d6b-4b97-9312-64f35a618c55', 'volume_name': 'volume-aef01faa-1d6b-4b97-9312-64f35a618c55', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049ed7fa-d880-4a0f-b7f6-68c7cd77cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049ed7fa-d880-4a0f-b7f6-68c7cd77cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa4714c-9328-4c3b-ab59-2622d90f94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Volume aef01faa-1d6b-4b97-9312-64f35a618c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef01faa-1d6b-4b97-9312-64f35a618c55', 'volume_size': 1} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee" returned: 0 in 0.457s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:09 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 1G" returned: 0 in 0.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa128e48-d882-4f70-909a-1b7bd089878b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:09 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 Sep 29 12:41:09 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:09 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:09 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5" returned: 0 in 0.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 is being set with open permissions: ugo+rw Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:10 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 Sep 29 12:41:10 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:10 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee Sep 29 12:41:10 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562357292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef01faa-1d6b-4b97-9312-64f35a618c55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c984c627e4465afe758df2ed6b179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:10Z,use_quota=True,user_id='d6604c71bf344ffeb5d1dd2831b7e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Creating volume aef01faa-1d6b-4b97-9312-64f35a618c55 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:10 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 1073741824 Sep 29 12:41:10 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b46dac0a-0f66-4268-9870-43ebbfcbb69e tempest-SnapshotsActionsTest-1724851305 None] Create snapshot completed successfully Sep 29 12:41:10 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:10 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee Sep 29 12:41:10 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 1073741824" returned: 0 in 0.473s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0.fc17815d-1018-4ad0-b56b-a53fc8df53ee" returned: 0 in 0.293s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:10 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 Sep 29 12:41:10 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-fc17815d-1018-4ad0-b56b-a53fc8df53ee" released by "_delete_snapshot" :: held 1.820s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" released by "delete_snapshot" :: held 1.857s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Created reservations ['2d9dee8b-f654-4b1e-bbe8-27c9575674a3', '36c6aa34-1c7e-4080-b0c2-57f89d0da5c4', '7600d66c-9635-4c41-90b9-3ec9e0f7481e', '7c8f7f9d-29ba-4869-a698-0605c59db768'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Delete snapshot completed successfully. Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d52af04-2683-4fbf-bbc7-d08fe08a821e tempest-VolumesExtendTest-329116544 None] Lock "cinder-fc17815d-1018-4ad0-b56b-a53fc8df53ee-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:11 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa4714c-9328-4c3b-ab59-2622d90f94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef01faa-1d6b-4b97-9312-64f35a618c55', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be6bf0-0d47-4a90-a643-df5bfccc3553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Volume volume-aef01faa-1d6b-4b97-9312-64f35a618c55 (aef01faa-1d6b-4b97-9312-64f35a618c55): created successfully Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be6bf0-0d47-4a90-a643-df5bfccc3553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Flow 'volume_create_manager' (d6560774-d8b3-440e-abdc-540410c439d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7d7dad7e-e61b-4189-a139-777f0b98f212 tempest-VolumesListTestJSON-66025255 None] Created volume successfully. Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-0a04a7fc-5567-47b2-bd30-3fecd679e0a0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "cinder-0a04a7fc-5567-47b2-bd30-3fecd679e0a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Acquiring lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280bd90-ae4b-4e6f-81e7-7ea3b08f0c60]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-2b4770d8-e704-461a-a088-3c5b92ba73b5-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:11 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:11 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-2b4770d8-e704-461a-a088-3c5b92ba73b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-2b4770d8-e704-461a-a088-3c5b92ba73b5" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-2b4770d8-e704-461a-a088-3c5b92ba73b5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Deleting offline snapshot 2b4770d8-e704-461a-a088-3c5b92ba73b5 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] snapshot_file for this snap is: volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfa461-dec3-4283-8e12-7f342795894f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:11 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 Sep 29 12:41:11 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:12 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.596s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:12 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0 Sep 29 12:41:12 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:12 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5" returned: 0 in 0.511s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[040efdbe-5893-4914-b22d-cbfc3e246732]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:12 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:12 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:12 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" returned: 0 in 0.398s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "cinder-quobyte-0a04a7fc-5567-47b2-bd30-3fecd679e0a0" released by "delete_volume" :: held 1.080s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Created reservations ['2f80385f-6893-46e0-a43a-71cb4466fd2d', 'aefaa7b0-3775-4ab8-a1ee-1d170caceb7d', '789f220e-1bac-40b6-a676-733feab67a79', '38524c4c-6b68-46a3-85c9-50037f5378ff'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:12 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:12 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:12 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:12 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 Sep 29 12:41:12 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:13 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Deleted volume successfully. Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bad76910-2c40-471d-9d04-dd1fa6a1f44c tempest-VolumesExtendTest-329116544 None] Lock "cinder-0a04a7fc-5567-47b2-bd30-3fecd679e0a0-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Flow 'volume_create_manager' (d8b37ede-9128-4b33-b719-8aae8d6a1d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8039fada-075b-4ef3-b060-9bb2ec28bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8039fada-075b-4ef3-b060-9bb2ec28bb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2014071626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcda6b1-0511-4525-b5c2-6b6ba798c72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2333936a14b749ba93b84c9819e1a37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:13Z,use_quota=True,user_id='35df2bc3bdc640c8bc068ea546890485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf4c653-19a9-43d3-b514-8d152cde3856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf4c653-19a9-43d3-b514-8d152cde3856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df82f7f-719a-49ec-a8c9-a41e9ca76973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:41:13 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:13 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5 Sep 29 12:41:13 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df82f7f-719a-49ec-a8c9-a41e9ca76973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9dcda6b1-0511-4525-b5c2-6b6ba798c72e', 'volume_name': 'volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c630dc66-6977-4e08-a283-321140067088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c630dc66-6977-4e08-a283-321140067088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da96f093-1cf8-4cfd-a432-fff7658cb577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Trying to clone 9dcda6b1-0511-4525-b5c2-6b6ba798c72e from image 94feb733-57cd-4052-a12a-6ab2ace34da5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:41:13 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.2b4770d8-e704-461a-a088-3c5b92ba73b5" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-2b4770d8-e704-461a-a088-3c5b92ba73b5" released by "_delete_snapshot" :: held 1.983s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_snapshot" :: held 2.025s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Created reservations ['72a9687a-f3e1-4435-8b48-63a29af56389', '00e52512-0470-492a-8269-5e17c046528b', 'b12af408-da8f-40e1-9c84-c53291cbba2c', 'a52c917d-a6a5-423a-a270-7114181bce07'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Delete snapshot completed successfully. Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d93bf63c-8cea-4055-a34e-927a5af83c8a tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-2b4770d8-e704-461a-a088-3c5b92ba73b5-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:41:14 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb040dc-99f9-4bf7-8182-8cd596e391c5]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:14 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD Sep 29 12:41:14 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:14 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 is fetched for user 35df2bc3bdc640c8bc068ea546890485. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed07ca-7be8-4822-b8b5-76d128f27fe7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:14 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD Sep 29 12:41:14 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-aef01faa-1d6b-4b97-9312-64f35a618c55-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-aef01faa-1d6b-4b97-9312-64f35a618c55-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-quobyte-aef01faa-1d6b-4b97-9312-64f35a618c55" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-aef01faa-1d6b-4b97-9312-64f35a618c55" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1c2433-df70-4ed1-9d9c-a453aad1ece3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:15 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2014071626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcda6b1-0511-4525-b5c2-6b6ba798c72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2333936a14b749ba93b84c9819e1a37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:13Z,use_quota=True,user_id='35df2bc3bdc640c8bc068ea546890485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Creating volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:15 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1073741824 Sep 29 12:41:15 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:15 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 Sep 29 12:41:15 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:15 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55" returned: 0 in 0.547s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:15 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55 Sep 29 12:41:15 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:15 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1073741824" returned: 0 in 0.683s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:15 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e Sep 29 12:41:15 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:15 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-aef01faa-1d6b-4b97-9312-64f35a618c55" returned: 0 in 0.398s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-aef01faa-1d6b-4b97-9312-64f35a618c55" released by "delete_volume" :: held 1.015s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Created reservations ['38ba57bb-6dc7-4f52-9889-41d5c7592578', '435f91a6-5ae8-47a9-becd-ce6ba344be8c', '8f6d3c4f-3ca2-4ba9-9f8b-5dc0c8d2cbbc', '4a4dfab7-3ece-4187-b4b1-0117bd8b0f2c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:16 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" returned: 0 in 0.311s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.920s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:16 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:16 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Creating offline snapshot 7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Attempting download of 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c35de-600d-43f6-b235-567e5e1c12fa]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d4cc2-d707-4bce-832a-37c85db10be6]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:16 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:16 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:16 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.300s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Deleted volume successfully. Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-235c4fc5-4c0c-4d32-8808-a195e8ea26c5 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-aef01faa-1d6b-4b97-9312-64f35a618c55-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:16 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh Sep 29 12:41:16 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:16 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:16 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh" returned: 0 in 0.404s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:16 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 1G Sep 29 12:41:16 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:16 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh Sep 29 12:41:16 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh" returned: 1 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_uv1826eh' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3f8bc9-01bd-4107-b5ef-53ad34e4cf36]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD Sep 29 12:41:17 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-14f2df56-0deb-4203-9f07-8ae404366e56-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "cinder-14f2df56-0deb-4203-9f07-8ae404366e56-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-quobyte-14f2df56-0deb-4203-9f07-8ae404366e56" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-14f2df56-0deb-4203-9f07-8ae404366e56" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:17 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 1G" returned: 0 in 0.680s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c961e-d74c-4dd9-9e0c-cbac01e0b67f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 Sep 29 12:41:17 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 Sep 29 12:41:17 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] 94feb733-57cd-4052-a12a-6ab2ace34da5 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e Sep 29 12:41:17 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" returned: 0 in 0.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:17 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 is being set with open permissions: ugo+rw Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 Sep 29 12:41:17 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:17 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56" returned: 0 in 0.459s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:17 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56 Sep 29 12:41:17 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:18 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6134a332-b90d-41dc-96eb-a06d7d1d6404 tempest-SnapshotsActionsTest-1724851305 None] Create snapshot completed successfully Sep 29 12:41:18 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-14f2df56-0deb-4203-9f07-8ae404366e56" returned: 0 in 0.334s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-14f2df56-0deb-4203-9f07-8ae404366e56" released by "delete_volume" :: held 0.861s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Created reservations ['7ab5a60d-0451-4436-ad2b-36e3e4194deb', 'f6641be7-e877-47ce-8622-b35c588cb847', '93be09be-aa1f-49b4-a939-b2c19ff5f042', 'cac25898-2301-4128-aa25-03958989b9c7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:18 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:18 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-2d092dda-89f0-4380-9257-becc11a0fca2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Deleting offline snapshot 7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:18 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] snapshot_file for this snap is: volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-2d092dda-89f0-4380-9257-becc11a0fca2-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30950d-be5f-4d44-9136-a8bec4cfc91b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Deleted volume successfully. Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9410537b-6570-4b9f-9644-0e513d7fda7a tempest-VolumesListTestJSON-66025255 None] Lock "cinder-14f2df56-0deb-4203-9f07-8ae404366e56-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Flow 'volume_create_manager' (a434d41e-c74b-43c8-8758-2bf95ad30d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7241b3ba-2d85-4efd-ba46-8229ceb8daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "cinder-quobyte-2d092dda-89f0-4380-9257-becc11a0fca2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7241b3ba-2d85-4efd-ba46-8229ceb8daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-226710182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fba3801-7a9f-4f80-bddc-04c5181b74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef168bc796a6490b8a31f5f64807c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:19Z,use_quota=True,user_id='488ea6cbc20441cfa581385bb7bb1835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8426eb-c3b4-480b-aa04-e21b8dfb108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8426eb-c3b4-480b-aa04-e21b8dfb108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fc52b-aef6-4c87-990c-92eedef74f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fc52b-aef6-4c87-990c-92eedef74f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fba3801-7a9f-4f80-bddc-04c5181b74ce', 'volume_name': 'volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbcee8d-6473-4be0-9c78-bab3ec088b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbcee8d-6473-4be0-9c78-bab3ec088b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85266351-6255-45f6-ba8c-6e73fb890b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce', 'volume_size': 1} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-226710182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fba3801-7a9f-4f80-bddc-04c5181b74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef168bc796a6490b8a31f5f64807c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:19Z,use_quota=True,user_id='488ea6cbc20441cfa581385bb7bb1835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Creating volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:19 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:19 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-2d092dda-89f0-4380-9257-becc11a0fca2" acquired by "delete_volume" :: waited 0.082s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:19 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce 1073741824 Sep 29 12:41:19 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf580d-1825-42fd-9fd9-80b221ae0155]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:19 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 Sep 29 12:41:19 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:19 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" returned: 0 in 0.529s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05efc4-3984-4506-bb6c-2b79a0b9abfe]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:19 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:19 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:19 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2" returned: 0 in 0.543s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:19 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce 1073741824" returned: 0 in 0.655s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:19 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2 Sep 29 12:41:19 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:19 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce Sep 29 12:41:19 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:20 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.561s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:20 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2d092dda-89f0-4380-9257-becc11a0fca2" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 Sep 29 12:41:20 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:20 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-quobyte-2d092dda-89f0-4380-9257-becc11a0fca2" released by "delete_volume" :: held 1.003s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce" returned: 0 in 0.316s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85266351-6255-45f6-ba8c-6e73fb890b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc7b85f-9afb-4a43-b21c-dded2b96e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:20 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" returned: 0 in 2.533s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_74gfqzi8devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Converted 112.00 MB image at 44.21 MB/s Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Volume volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce (1fba3801-7a9f-4f80-bddc-04c5181b74ce): created successfully Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc7b85f-9afb-4a43-b21c-dded2b96e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:20 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1G Sep 29 12:41:20 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Flow 'volume_create_manager' (a434d41e-c74b-43c8-8758-2bf95ad30d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-12d340cf-e0f5-442b-ab74-fb453e0a9623 tempest-VolumesSnapshotListTestJSON-694844010 None] Created volume successfully. Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Created reservations ['639579a6-b61f-4325-8037-506cf435f4d3', '71435970-5b1a-4f73-8ae5-6d555d8d6ea3', '9a7af826-f8a7-4a1f-9741-f319e226dcfd', '873a62c8-2683-46e0-b53e-f47c5f7f29c2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:20 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:20 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:20 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" returned: 0 in 0.434s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:20 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e 1G" returned: 0 in 0.362s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Downloaded image 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:41:20 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620 Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 for user 35df2bc3bdc640c8bc068ea546890485 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Marking volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:41:20 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Copying metadata from image 94feb733-57cd-4052-a12a-6ab2ace34da5 to 9dcda6b1-0511-4525-b5c2-6b6ba798c72e. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Creating volume glance metadata for volume 9dcda6b1-0511-4525-b5c2-6b6ba798c72e backed by image 94feb733-57cd-4052-a12a-6ab2ace34da5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:41:20 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.276s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Deleted volume successfully. Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-84df3e25-1551-446d-999e-ae2379925773 tempest-VolumesListTestJSON-66025255 None] Lock "cinder-2d092dda-89f0-4380-9257-becc11a0fca2-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da96f093-1cf8-4cfd-a432-fff7658cb577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf47451-5782-4385-a7e8-00d904c20d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Volume volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e (9dcda6b1-0511-4525-b5c2-6b6ba798c72e): created successfully Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf47451-5782-4385-a7e8-00d904c20d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Flow 'volume_create_manager' (d8b37ede-9128-4b33-b719-8aae8d6a1d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-336a3282-684c-4810-8b74-544f1f0ba0c5 tempest-VolumesImageMetadata-955518007 None] Created volume successfully. Sep 29 12:41:20 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620" released by "_delete_snapshot" :: held 1.946s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_snapshot" :: held 1.981s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Created reservations ['b62c1ea3-ba17-482d-b2e6-2b2d23fb4c8a', 'e9604acd-9501-4611-b971-cd4ae8be62e3', '71131805-c15d-4f51-8200-637264c14bad', '61658396-0089-4689-b473-cf8a0dae7c37'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Delete snapshot completed successfully. Sep 29 12:41:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa6cf28d-c2f8-434d-806e-3ad2fc2dce8c tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-7d2ed0c7-1ca2-46be-9fb7-b0200cfb8620-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Creating offline snapshot e36bb89e-2d1b-49a7-96b2-e89dbccf05dd of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22fa264-9240-4efc-8295-e27d6776f35d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:21 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce Sep 29 12:41:21 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Acquiring lock "cinder-9dcda6b1-0511-4525-b5c2-6b6ba798c72e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "cinder-9dcda6b1-0511-4525-b5c2-6b6ba798c72e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Acquiring lock "cinder-quobyte-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "cinder-quobyte-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eef482-7ebe-4648-99bd-b1bb00af8774]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:21 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e Sep 29 12:41:21 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:21 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce" returned: 0 in 0.482s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:21 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd 1G Sep 29 12:41:21 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:22 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:22 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e Sep 29 12:41:22 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:22 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd 1G" returned: 0 in 0.516s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:22 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:22 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:22 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "cinder-quobyte-9dcda6b1-0511-4525-b5c2-6b6ba798c72e" released by "delete_volume" :: held 0.737s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Created reservations ['0fd8099a-c595-4b41-8397-ee973fdfd716', '3f9a8a87-725b-4194-a159-aedbeb34814b', '6a6cc7bf-8d06-4dc4-bbab-524229a26f31', '0816bb8c-e1b3-411b-8513-b2cb88767b9b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:22 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:22 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:22 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:22 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd is being set with open permissions: ugo+rw Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:22 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:22 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:22 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.350s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Deleted volume successfully. Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-874be540-27e0-48bd-801f-217bd2f60a4d tempest-VolumesImageMetadata-955518007 None] Lock "cinder-9dcda6b1-0511-4525-b5c2-6b6ba798c72e-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:22 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.290s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:23 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info Sep 29 12:41:23 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:23 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:23 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info is being set with open permissions: ugo+rw Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:23 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info Sep 29 12:41:23 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:23 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.info" returned: 0 in 0.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.109s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Creating offline snapshot 21f9e5a8-affd-422a-afab-7b13a82ede28 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eea7b813-f82c-4316-ab25-2d4c1c55ca85 tempest-VolumesSnapshotListTestJSON-694844010 None] Create snapshot completed successfully Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbbe47-893a-4b47-92d4-49e84eb24196]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:23 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:23 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:24 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.444s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:24 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 1G Sep 29 12:41:24 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:24 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 1G" returned: 0 in 0.619s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:24 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 Sep 29 12:41:24 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:25 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:25 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 is being set with open permissions: ugo+rw Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:25 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 Sep 29 12:41:25 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:25 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.914s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Creating offline snapshot 568d479f-ba11-4aa8-96d8-daaf18270304 of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8905d6-6871-44b1-b341-e56d3ecbe628]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ff3a932-7179-4562-8656-2e776205f3e5 tempest-SnapshotsActionsTest-1724851305 None] Create snapshot completed successfully Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:25 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:25 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-21f9e5a8-affd-422a-afab-7b13a82ede28-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-21f9e5a8-affd-422a-afab-7b13a82ede28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-21f9e5a8-affd-422a-afab-7b13a82ede28" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-21f9e5a8-affd-422a-afab-7b13a82ede28" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Deleting offline snapshot 21f9e5a8-affd-422a-afab-7b13a82ede28 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] snapshot_file for this snap is: volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[98259d5e-b8a1-4d3c-93a0-1691f755b08e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:26 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.661s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:26 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 Sep 29 12:41:26 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:26 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 1G Sep 29 12:41:26 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:26 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28" returned: 0 in 0.591s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[82abe306-9301-49ad-b1f8-b789db931b70]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:26 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:26 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:27 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 1G" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:27 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:27 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:27 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.576s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:27 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 Sep 29 12:41:27 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:27 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.402s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:27 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 is being set with open permissions: ugo+rw Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:27 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:27 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:27 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.360s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (7b52c07b-16df-4c09-9d01-045e9df79fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e8b5e6-8d26-49a6-9422-6cc2e379f427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e8b5e6-8d26-49a6-9422-6cc2e379f427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1013053266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c020e734-6cb2-48d6-85ba-a285a72dcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0990de8b5a4417795aaaed79a919cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:28Z,use_quota=True,user_id='153ac4956cdc4af7a300b54735ac923e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952402f-3054-41bb-8b3b-33260d1c07e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952402f-3054-41bb-8b3b-33260d1c07e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75da7454-e907-46e6-9ce3-72b2d6a0abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75da7454-e907-46e6-9ce3-72b2d6a0abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c020e734-6cb2-48d6-85ba-a285a72dcba9', 'volume_name': 'volume-c020e734-6cb2-48d6-85ba-a285a72dcba9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b978e270-f11c-49e5-bd10-5eb59fcf53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b978e270-f11c-49e5-bd10-5eb59fcf53c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edee2d3-dcee-4a50-87ac-43b9853e3d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Volume c020e734-6cb2-48d6-85ba-a285a72dcba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c020e734-6cb2-48d6-85ba-a285a72dcba9', 'volume_size': 1} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:27 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1013053266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c020e734-6cb2-48d6-85ba-a285a72dcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0990de8b5a4417795aaaed79a919cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:28Z,use_quota=True,user_id='153ac4956cdc4af7a300b54735ac923e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Creating volume c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:27 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28" returned: 0 in 0.617s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:28 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 1073741824 Sep 29 12:41:28 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:28 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28 Sep 29 12:41:28 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3d00ca1c-a137-46a0-90d4-bcf529a58926 tempest-VolumesSnapshotListTestJSON-694844010 None] Create snapshot completed successfully Sep 29 12:41:28 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.21f9e5a8-affd-422a-afab-7b13a82ede28" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-21f9e5a8-affd-422a-afab-7b13a82ede28" released by "_delete_snapshot" :: held 2.276s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_snapshot" :: held 2.321s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Created reservations ['40ea0a36-5ddb-4926-9b9a-31861b8cf6d5', '61e26b4d-a618-4550-aec9-e5444e7bbf7a', 'f72ff5dd-7b71-44af-a81d-5fcd7a6956ca', 'd10af287-ebe0-4087-9756-9182976f814f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Delete snapshot completed successfully. Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19a2f87-87cb-4581-9177-56125a7229d2 tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-21f9e5a8-affd-422a-afab-7b13a82ede28-delete_snapshot" released by "delete_snapshot" :: held 2.509s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:28 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 1073741824" returned: 0 in 0.531s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:28 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 Sep 29 12:41:28 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:28 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9" returned: 0 in 0.258s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edee2d3-dcee-4a50-87ac-43b9853e3d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c020e734-6cb2-48d6-85ba-a285a72dcba9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f48676-17bf-4b47-9df4-d9f5b8cf0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Volume volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 (c020e734-6cb2-48d6-85ba-a285a72dcba9): created successfully Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f48676-17bf-4b47-9df4-d9f5b8cf0889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (7b52c07b-16df-4c09-9d01-045e9df79fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-13a753e1-3a84-4c50-ae06-f8aaaf368bf9 tempest-VolumesDeleteCascade-88783190 None] Created volume successfully. Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Creating offline snapshot 89d308d7-66de-4144-bbbc-3ee4cf62be8c of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d16c32-6775-4c35-ba45-8fb644733fa4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:29 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:29 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:29 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:29 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c 1G Sep 29 12:41:29 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:30 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c 1G" returned: 0 in 0.566s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:30 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:30 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:30 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c Sep 29 12:41:30 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:30 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:41:30 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c" returned: 0 in 0.450s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c is being set with open permissions: ugo+rw Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:30 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c Sep 29 12:41:30 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:30 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c" returned: 0 in 0.279s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.448s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Creating offline snapshot ec945c6c-72a4-41d4-9718-2247a67144e9 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-58197b2c-a3bc-4b22-bd6d-1c5c7a7a6fac tempest-VolumesSnapshotListTestJSON-694844010 None] Create snapshot completed successfully Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf2c49-f189-41fd-a280-5708110a2e60]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:31 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:31 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:31 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:31 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 1G Sep 29 12:41:31 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:32 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 1G" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:32 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 Sep 29 12:41:32 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-89d308d7-66de-4144-bbbc-3ee4cf62be8c-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-89d308d7-66de-4144-bbbc-3ee4cf62be8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-89d308d7-66de-4144-bbbc-3ee4cf62be8c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-89d308d7-66de-4144-bbbc-3ee4cf62be8c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Deleting offline snapshot 89d308d7-66de-4144-bbbc-3ee4cf62be8c of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] snapshot_file for this snap is: volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c31d6-8e43-41d4-b8e0-b48b292a4bee]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:32 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9" returned: 0 in 0.442s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 is being set with open permissions: ugo+rw Sep 29 12:41:32 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c Sep 29 12:41:32 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:32 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 Sep 29 12:41:32 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:33 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9" returned: 0 in 0.344s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:33 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.088s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c" returned: 0 in 0.609s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Creating offline snapshot e4ca7ef7-a664-40b4-b265-9e0e2c58a94d of volume c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-135f127d-b000-428f-a0db-6452eabb1652 tempest-SnapshotsActionsTest-1724851305 None] Create snapshot completed successfully Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45c1fe-9ebf-444f-8e0f-9227de0e3881]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7bffe3-3276-4ec9-9520-a7d3f53223f8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:33 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 Sep 29 12:41:33 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:33 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:33 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:33 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:33 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d 1G Sep 29 12:41:33 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:33 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.471s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:33 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c Sep 29 12:41:33 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-ec945c6c-72a4-41d4-9718-2247a67144e9-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-ec945c6c-72a4-41d4-9718-2247a67144e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Acquiring lock "cinder-quobyte-ec945c6c-72a4-41d4-9718-2247a67144e9" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-ec945c6c-72a4-41d4-9718-2247a67144e9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Deleting offline snapshot ec945c6c-72a4-41d4-9718-2247a67144e9 of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] snapshot_file for this snap is: volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f7ad7-189d-4a6d-a437-95102bbad935]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:34 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:34 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c" returned: 0 in 0.539s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d 1G" returned: 0 in 0.605s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:34 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:34 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:34 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c Sep 29 12:41:34 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:34 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 Sep 29 12:41:34 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:34 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:34 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:34 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d is being set with open permissions: ugo+rw Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.89d308d7-66de-4144-bbbc-3ee4cf62be8c" returned: 0 in 0.420s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:34 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:34 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-89d308d7-66de-4144-bbbc-3ee4cf62be8c" released by "_delete_snapshot" :: held 2.192s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" released by "delete_snapshot" :: held 2.233s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:34 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[53700e0f-5c42-4ffd-ab57-8ea830572dba]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Created reservations ['413e8d22-407f-42be-9cf7-c24ec25624ef', '5190cc6b-980d-4fed-96de-13e246988178', '52574c3a-4a0a-4a0e-b519-5e531166f98a', 'eaf85312-2010-4aea-9980-ba8ac83cf6ef'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Delete snapshot completed successfully. Sep 29 12:41:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6a0dda22-1d46-42b5-a6bc-1613bbfbd0e7 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-89d308d7-66de-4144-bbbc-3ee4cf62be8c-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:35 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:35 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:35 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.469s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:35 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info Sep 29 12:41:35 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:35 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.557s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:35 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 Sep 29 12:41:35 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:35 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info" returned: 0 in 0.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:35 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info is being set with open permissions: ugo+rw Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:35 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info Sep 29 12:41:35 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-568d479f-ba11-4aa8-96d8-daaf18270304-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-568d479f-ba11-4aa8-96d8-daaf18270304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-568d479f-ba11-4aa8-96d8-daaf18270304" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-568d479f-ba11-4aa8-96d8-daaf18270304" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Deleting offline snapshot 568d479f-ba11-4aa8-96d8-daaf18270304 of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] snapshot_file for this snap is: volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:35 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.info" returned: 0 in 0.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae4738d-9a8a-455c-bc71-f4cf0f2095b8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fd5e3d53-149f-4add-9a9b-42885d69fdbf tempest-VolumesDeleteCascade-88783190 None] Create snapshot completed successfully Sep 29 12:41:35 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9" returned: 0 in 0.531s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:35 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:35 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:35 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9 Sep 29 12:41:35 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:36 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.ec945c6c-72a4-41d4-9718-2247a67144e9" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-ec945c6c-72a4-41d4-9718-2247a67144e9" released by "_delete_snapshot" :: held 2.106s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:36 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_snapshot" :: held 2.143s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.443s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[776070cd-246e-4a78-ae61-36ed010fad7e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Created reservations ['07d78cda-6a5f-43af-aeb4-5a2b02cf183c', 'ef65f08f-e218-4ff1-bce2-873c533ea848', '79c46ca2-01c0-4875-b8ae-5bbfece2829b', '7cc89be5-0617-4644-ae93-d9df86b84e9d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:36 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:36 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Delete snapshot completed successfully. Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-914a010d-e214-4800-a45d-18579781072f tempest-SnapshotsActionsTest-1922817763 None] Lock "cinder-ec945c6c-72a4-41d4-9718-2247a67144e9-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Creating offline snapshot 728da288-7725-48fa-ab09-ab91482cd046 of volume c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[11973cbb-94ce-41e5-9a55-7d4a6ec645a1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:36 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:36 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:36 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:36 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:36 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (3204b0c8-a93f-4415-b94f-4b7aa2d21dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b50358-2fbb-48ea-86bd-cdccc77796fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b50358-2fbb-48ea-86bd-cdccc77796fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306558197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739abbbb-7f17-45be-ab5a-0d12afff66e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:37Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efff84f-82b3-4114-ba2f-3983e70137cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efff84f-82b3-4114-ba2f-3983e70137cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c13d86a-b007-4b0f-be19-5518f8322cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c13d86a-b007-4b0f-be19-5518f8322cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739abbbb-7f17-45be-ab5a-0d12afff66e4', 'volume_name': 'volume-739abbbb-7f17-45be-ab5a-0d12afff66e4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88135e24-5798-444a-ac26-13173c1e7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88135e24-5798-444a-ac26-13173c1e7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ee0c5-bfe6-4322-8e24-ee1b338ecdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Volume 739abbbb-7f17-45be-ab5a-0d12afff66e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739abbbb-7f17-45be-ab5a-0d12afff66e4', 'volume_size': 1} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:37 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.391s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c020e734-6cb2-48d6-85ba-a285a72dcba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:37 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 1G Sep 29 12:41:37 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:37 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:37 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304 Sep 29 12:41:37 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:37 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.568d479f-ba11-4aa8-96d8-daaf18270304" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-568d479f-ba11-4aa8-96d8-daaf18270304" released by "_delete_snapshot" :: held 1.708s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" released by "delete_snapshot" :: held 1.742s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Created reservations ['efca73cb-7b36-4267-bd13-4b12ba95c601', '15a41f0a-1824-44a7-afcd-b6f2fe0a5029', 'c87a00c4-7877-4aa2-88a5-46e5d8247775', '6c68beb9-c107-4906-ba77-74a8ba86c02d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:37 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 1G" returned: 0 in 0.537s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:37 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 Sep 29 12:41:37 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Delete snapshot completed successfully. Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b99258-7e19-4955-97fe-c575381748d0 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-568d479f-ba11-4aa8-96d8-daaf18270304-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "cinder-732ec7b8-b4cf-4928-b456-1f965192e63a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-732ec7b8-b4cf-4928-b456-1f965192e63a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "cinder-quobyte-732ec7b8-b4cf-4928-b456-1f965192e63a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-732ec7b8-b4cf-4928-b456-1f965192e63a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Deleting offline snapshot 732ec7b8-b4cf-4928-b456-1f965192e63a of volume 51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] snapshot_file for this snap is: volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5e81b-a8d9-4d4c-b8ab-25e897c30dd1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:37 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046" returned: 0 in 0.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:37 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 is being set with open permissions: ugo+rw Sep 29 12:41:37 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:37 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 Sep 29 12:41:37 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Deleting offline snapshot e36bb89e-2d1b-49a7-96b2-e89dbccf05dd of volume 1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] snapshot_file for this snap is: volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c00322d-ccd8-4f6e-84e8-34bb99b8a472]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:38 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.640s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306558197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739abbbb-7f17-45be-ab5a-0d12afff66e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:37Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Creating volume 739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.460s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a44b22-c953-4a66-a855-7a244bb9f983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:38 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 1073741824 Sep 29 12:41:38 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c8126-30a5-4984-a8a8-09b76d04ad45]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-899931ec-412d-4396-aa5f-3ffa9b75b6f5 tempest-VolumesDeleteCascade-88783190 None] Create snapshot completed successfully Sep 29 12:41:38 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:38 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 Sep 29 12:41:38 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d1963-56e7-4909-bf5b-28571941ff99]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce Sep 29 12:41:38 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:38 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-c020e734-6cb2-48d6-85ba-a285a72dcba9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 1073741824" returned: 0 in 0.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-c020e734-6cb2-48d6-85ba-a285a72dcba9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Performing cascade delete. {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 12:41:38 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce" returned: 0 in 0.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:38 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 Sep 29 12:41:38 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-728da288-7725-48fa-ab09-ab91482cd046-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:38 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-728da288-7725-48fa-ab09-ab91482cd046-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-728da288-7725-48fa-ab09-ab91482cd046" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-728da288-7725-48fa-ab09-ab91482cd046" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Deleting offline snapshot 728da288-7725-48fa-ab09-ab91482cd046 of volume c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] snapshot_file for this snap is: volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd54ed4-bca0-4ae7-a169-985850ae352c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:39 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4" returned: 0 in 0.318s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:39 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.477s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ee0c5-bfe6-4322-8e24-ee1b338ecdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739abbbb-7f17-45be-ab5a-0d12afff66e4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:39 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a Sep 29 12:41:39 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d46534-f2e3-4c96-9fe8-55db63e4802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:39 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:39 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Volume volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 (739abbbb-7f17-45be-ab5a-0d12afff66e4): created successfully Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d46534-f2e3-4c96-9fe8-55db63e4802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (3204b0c8-a93f-4415-b94f-4b7aa2d21dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-34a29994-25ad-49d8-9c5a-6b26bcd0803d tempest-VolumesSnapshotTestJSON-1474533700 None] Created volume successfully. Sep 29 12:41:39 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.436s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:39 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd Sep 29 12:41:39 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:39 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983.732ec7b8-b4cf-4928-b456-1f965192e63a" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c020e734-6cb2-48d6-85ba-a285a72dcba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-732ec7b8-b4cf-4928-b456-1f965192e63a" released by "_delete_snapshot" :: held 1.756s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_snapshot" :: held 1.778s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d51546-a32a-4bd5-974f-0f8c5bb1da91]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:39 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce.e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Created reservations ['e5951af6-6cfc-44ca-89f7-8795403c943b', 'ce3d8bf5-af8b-4d7a-8185-c60b7cf9ffa6', '5a1e9afa-4afe-4218-a4f0-d6cdf62c8e40', '9919d60a-a5d8-46f0-9da5-bfed8a92f53d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd" released by "_delete_snapshot" :: held 1.649s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" released by "delete_snapshot" :: held 1.678s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:39 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Delete snapshot completed successfully. Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e1f475f-d42d-402b-a73d-114e98443833 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-732ec7b8-b4cf-4928-b456-1f965192e63a-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Created reservations ['05df6898-d8ae-476a-9766-2f6acc682481', 'e6a4afab-3897-4dd9-ab03-deed8c48c2d7', 'da09c09f-4086-4597-aa23-2af2957999e0', 'c9c590f6-b499-4a16-9b8f-de16d3151be0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Delete snapshot completed successfully. Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d443b1a1-1b45-4727-82ab-996d36678cec tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-e36bb89e-2d1b-49a7-96b2-e89dbccf05dd-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "cinder-51a44b22-c953-4a66-a855-7a244bb9f983-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-51a44b22-c953-4a66-a855-7a244bb9f983-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:39 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c020e734-6cb2-48d6-85ba-a285a72dcba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:39 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 Sep 29 12:41:39 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b233ed48-1660-4252-ad2d-9198b3b4afd5]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-1fba3801-7a9f-4f80-bddc-04c5181b74ce-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-1fba3801-7a9f-4f80-bddc-04c5181b74ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:40 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 Sep 29 12:41:40 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[671726f2-9a1e-4d3e-ba33-3f8d351f7285]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046" returned: 0 in 0.528s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce Sep 29 12:41:40 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046 Sep 29 12:41:40 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating offline snapshot c95ef312-3d4c-4992-8884-c617bf24241a of volume 739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca58128-eabe-4349-9b2c-d9f5fc70f9bb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983" returned: 0 in 0.477s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983 Sep 29 12:41:40 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 Sep 29 12:41:40 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.728da288-7725-48fa-ab09-ab91482cd046" returned: 0 in 0.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:40 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce" returned: 0 in 0.454s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-728da288-7725-48fa-ab09-ab91482cd046" released by "_delete_snapshot" :: held 1.836s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" released by "delete_snapshot" :: held 1.872s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:40 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce Sep 29 12:41:40 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:40 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-51a44b22-c953-4a66-a855-7a244bb9f983" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-quobyte-51a44b22-c953-4a66-a855-7a244bb9f983" released by "delete_volume" :: held 0.860s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['93984453-6582-4b22-9d5b-bc570441fcb2', 'a46c3571-0ca6-4809-bcb5-8daa445b8df0', '1e8accf7-e758-4080-8b31-cab9b2139c31', 'f0020585-964d-4e91-ad0b-aeb66a66f540'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Created reservations ['ded7b1eb-e55b-4e03-8613-5a6da60c2c84', '384e7230-a455-432e-b6b9-9fa06ebb63c6', 'bfeb38e6-b714-4f31-a43a-f27e8392cd5a', '64f13cb1-2874-4233-8d84-9dc838c198c7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:41 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Delete snapshot completed successfully. Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-728da288-7725-48fa-ab09-ab91482cd046-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:41 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a 1G Sep 29 12:41:41 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:41 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fba3801-7a9f-4f80-bddc-04c5181b74ce" returned: 0 in 0.323s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-quobyte-1fba3801-7a9f-4f80-bddc-04c5181b74ce" released by "delete_volume" :: held 0.854s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Deleting offline snapshot e4ca7ef7-a664-40b4-b265-9e0e2c58a94d of volume c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] snapshot_file for this snap is: volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f1d3b-ce77-42cb-bdb7-3f227553af61]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:41 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Created reservations ['7ec36fef-6195-440b-b35b-27baa961b74b', 'deb15ab8-cc69-4ab4-8a6b-a505a1a6200b', '0549c8e0-504b-4da9-b0d0-31eaa70f5948', '56b8d2bb-72c4-42a3-839f-f7463a26e7c0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:41 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:41 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:41 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a 1G" returned: 0 in 0.504s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a Sep 29 12:41:41 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Deleted volume successfully. Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-47d329b6-da3b-4f9f-8764-6d93bf95d0b2 tempest-SnapshotsActionsTest-1724851305 None] Lock "cinder-51a44b22-c953-4a66-a855-7a244bb9f983-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:41 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c020e734-6cb2-48d6-85ba-a285a72dcba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23b875d-0af1-4c55-9493-003998d42ac7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.348s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Deleted volume successfully. Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bbdf8cd5-3d38-49b5-a60d-636e1b302ee2 tempest-VolumesSnapshotListTestJSON-694844010 None] Lock "cinder-1fba3801-7a9f-4f80-bddc-04c5181b74ce-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:41 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 Sep 29 12:41:41 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:41 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a" returned: 0 in 0.300s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:41 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a is being set with open permissions: ugo+rw Sep 29 12:41:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:41 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a Sep 29 12:41:41 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:42 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9" returned: 0 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:42 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:42 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:42 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:42 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info Sep 29 12:41:42 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:42 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.419s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info is being set with open permissions: ugo+rw Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:42 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d Sep 29 12:41:42 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:42 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info Sep 29 12:41:42 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:42 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9.e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" returned: 0 in 0.315s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.info" returned: 0 in 0.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d" released by "_delete_snapshot" :: held 1.693s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" released by "delete_snapshot" :: held 1.731s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b118d7e0-b253-45e7-aeab-501dc0b56715 tempest-VolumesSnapshotTestJSON-1474533700 None] Create snapshot completed successfully Sep 29 12:41:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['b4816a25-0873-4fc5-8f8c-aedec31f7201', 'c163a362-aa2a-4600-b72e-03374a16c07e', 'c833b67b-4c01-41bc-b9bc-2c7da3c1234f', '4d2361c6-28ad-4fe4-9c32-e6ddbf747244'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Delete snapshot completed successfully. Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-e4ca7ef7-a664-40b4-b265-9e0e2c58a94d-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Snapshots deleted, issuing volume delete {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661c26f-6700-4e34-ba51-82cb2a1703d3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:43 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 Sep 29 12:41:43 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:43 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9" returned: 0 in 0.399s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:43 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9 Sep 29 12:41:43 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:43 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-c95ef312-3d4c-4992-8884-c617bf24241a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c020e734-6cb2-48d6-85ba-a285a72dcba9" returned: 0 in 0.364s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-c020e734-6cb2-48d6-85ba-a285a72dcba9" released by "delete_volume" :: held 0.863s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c95ef312-3d4c-4992-8884-c617bf24241a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['9ee419fe-54d4-4fe2-b943-7e1e277f92c3', '54efa7ba-0184-44f1-9f28-66e161ade80b', 'd0c8e91b-2029-4c2b-9e32-041d1ff24743', '341baf77-1a48-49ce-ba94-97ef2cbd614c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-c95ef312-3d4c-4992-8884-c617bf24241a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c95ef312-3d4c-4992-8884-c617bf24241a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Deleting offline snapshot c95ef312-3d4c-4992-8884-c617bf24241a of volume 739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] snapshot_file for this snap is: volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[da889227-7a44-436e-99aa-7444d926bb10]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:44 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:41:44 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:44 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a Sep 29 12:41:44 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:44 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.398s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:41:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Deleted volume successfully. Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2374b35f-776b-4938-8a93-43284f1e9960 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-c020e734-6cb2-48d6-85ba-a285a72dcba9-delete_volume" released by "delete_volume" :: held 5.834s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:44 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a" returned: 0 in 0.487s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739abbbb-7f17-45be-ab5a-0d12afff66e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a214715-181e-4b02-bcfc-dcfd5a2c69df]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:44 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 Sep 29 12:41:44 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:45 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4" returned: 0 in 0.481s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:45 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a Sep 29 12:41:45 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (f55c3ac3-e659-4082-83a0-ed56af0f1801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81424afe-7677-417b-9408-4676b148d390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81424afe-7677-417b-9408-4676b148d390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409399372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52353cc-5a2b-40cc-84d7-fe672680e394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0990de8b5a4417795aaaed79a919cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:46Z,use_quota=True,user_id='153ac4956cdc4af7a300b54735ac923e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d436323-8d80-4d8c-a949-ff7ce55b8cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:45 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d436323-8d80-4d8c-a949-ff7ce55b8cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf17a15c-903d-4efc-ba95-9010cd3086b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf17a15c-903d-4efc-ba95-9010cd3086b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52353cc-5a2b-40cc-84d7-fe672680e394', 'volume_name': 'volume-e52353cc-5a2b-40cc-84d7-fe672680e394', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc01f5b-f17b-4840-8ee5-dd6db2049a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc01f5b-f17b-4840-8ee5-dd6db2049a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111e35fa-3ffa-403f-901c-5f0b895e2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Volume e52353cc-5a2b-40cc-84d7-fe672680e394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52353cc-5a2b-40cc-84d7-fe672680e394', 'volume_size': 1} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409399372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52353cc-5a2b-40cc-84d7-fe672680e394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0990de8b5a4417795aaaed79a919cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:46Z,use_quota=True,user_id='153ac4956cdc4af7a300b54735ac923e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Creating volume e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:45 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a" returned: 0 in 0.513s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:45 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 1073741824 Sep 29 12:41:45 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:45 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a Sep 29 12:41:45 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:45 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4.c95ef312-3d4c-4992-8884-c617bf24241a" returned: 0 in 0.311s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c95ef312-3d4c-4992-8884-c617bf24241a" released by "_delete_snapshot" :: held 1.981s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" released by "delete_snapshot" :: held 2.011s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['383b5b6f-a88c-4ccd-af75-8befbb992cc3', 'a7308fe1-79c5-4884-8d71-3ee7e63df0d1', 'cda15319-08c8-4070-b55e-eb013e186926', 'b7a458bd-453b-4e8c-8056-17fd6485eaf7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:41:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Delete snapshot completed successfully. Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9534f165-62c8-4d0e-9ccf-0653bbf85041 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c95ef312-3d4c-4992-8884-c617bf24241a-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:41:46 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 1073741824" returned: 0 in 0.638s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:46 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:41:46 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:46 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111e35fa-3ffa-403f-901c-5f0b895e2c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52353cc-5a2b-40cc-84d7-fe672680e394', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3547623-c2ea-4796-993e-47af3270f32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Volume volume-e52353cc-5a2b-40cc-84d7-fe672680e394 (e52353cc-5a2b-40cc-84d7-fe672680e394): created successfully Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3547623-c2ea-4796-993e-47af3270f32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (f55c3ac3-e659-4082-83a0-ed56af0f1801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5e002332-0bec-4c6f-9ce0-907be59b5675 tempest-VolumesDeleteCascade-88783190 None] Created volume successfully. Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (fce5dcb3-be79-44b6-8143-d4a13cd1f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cf771e-bc6e-48bb-8694-2aed2909ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Creating offline snapshot 314a2192-ae95-4156-95d7-149d7ea7ebac of volume e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cf771e-bc6e-48bb-8694-2aed2909ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-852217209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e02227-b331-4261-8b2a-c3b4789ee0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:48Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2278ab-ba4f-47ff-9d51-7dcea9b447b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2278ab-ba4f-47ff-9d51-7dcea9b447b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abeb99d-e128-4b58-b7ef-1974e69f97e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abeb99d-e128-4b58-b7ef-1974e69f97e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e02227-b331-4261-8b2a-c3b4789ee0f3', 'volume_name': 'volume-22e02227-b331-4261-8b2a-c3b4789ee0f3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d62dcf1-3462-4336-ad07-48b560095796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d62dcf1-3462-4336-ad07-48b560095796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb71ec4-d620-4027-93b9-0b19214b73ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume 22e02227-b331-4261-8b2a-c3b4789ee0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e02227-b331-4261-8b2a-c3b4789ee0f3', 'volume_size': 1} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d5cc0-a64b-455d-a123-0997d55c935f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:48 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:41:48 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:48 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.424s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:48 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac 1G Sep 29 12:41:48 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:49 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac 1G" returned: 0 in 0.490s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52353cc-5a2b-40cc-84d7-fe672680e394 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:49 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52353cc-5a2b-40cc-84d7-fe672680e394 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:41:49 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:49 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52353cc-5a2b-40cc-84d7-fe672680e394 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.343s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:49 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac is being set with open permissions: ugo+rw Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:49 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:41:49 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:49 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:49 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info Sep 29 12:41:49 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:50 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info" returned: 0 in 0.370s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:50 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info is being set with open permissions: ugo+rw Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:50 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info Sep 29 12:41:50 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:50 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.info" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-852217209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e02227-b331-4261-8b2a-c3b4789ee0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:48Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating volume 22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:50 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:50 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 1073741824 Sep 29 12:41:50 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-43b0d2e1-114b-4221-988e-31416c47abd4 tempest-VolumesDeleteCascade-88783190 None] Create snapshot completed successfully Sep 29 12:41:50 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 1073741824" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:50 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:41:50 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:51 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb71ec4-d620-4027-93b9-0b19214b73ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e02227-b331-4261-8b2a-c3b4789ee0f3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7d1c4a-a9f2-4a96-b918-7d8bc1d29f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 (22e02227-b331-4261-8b2a-c3b4789ee0f3): created successfully Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7d1c4a-a9f2-4a96-b918-7d8bc1d29f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (fce5dcb3-be79-44b6-8143-d4a13cd1f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-299d8c41-197f-4295-83e6-251387b01ea7 tempest-VolumesSnapshotTestJSON-1474533700 None] Created volume successfully. Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (25adaffe-b309-4f49-a630-ff3d1a380d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14746ea2-8dac-46ed-9fc3-9d6d20e097b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14746ea2-8dac-46ed-9fc3-9d6d20e097b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-675670575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200b6f05-dbf7-4f76-b32a-e3a0e8019529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0990de8b5a4417795aaaed79a919cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=314a2192-ae95-4156-95d7-149d7ea7ebac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:52Z,use_quota=True,user_id='153ac4956cdc4af7a300b54735ac923e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa9db99-bce8-4c88-a979-061ad29cc61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa9db99-bce8-4c88-a979-061ad29cc61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b88f045-cc4e-495d-83b5-5caf58d8e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b88f045-cc4e-495d-83b5-5caf58d8e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '200b6f05-dbf7-4f76-b32a-e3a0e8019529', 'volume_name': 'volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529', 'volume_size': 1, 'snapshot_id': '314a2192-ae95-4156-95d7-149d7ea7ebac'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0400ad9c-7792-4194-b09b-e4e81e1ef242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0400ad9c-7792-4194-b09b-e4e81e1ef242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426b7a3-204a-4386-a01b-41d53bda4af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:41:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Volume 200b6f05-dbf7-4f76-b32a-e3a0e8019529: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529', 'volume_size': 1, 'snapshot_id': '314a2192-ae95-4156-95d7-149d7ea7ebac'} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac-200b6f05-dbf7-4f76-b32a-e3a0e8019529" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac-200b6f05-dbf7-4f76-b32a-e3a0e8019529" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Creating volume 200b6f05-dbf7-4f76-b32a-e3a0e8019529 from snapshot 314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] snapshot: 314a2192-ae95-4156-95d7-149d7ea7ebac, volume: 200b6f05-dbf7-4f76-b32a-e3a0e8019529, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4a7c8-d3b9-4d4b-8970-4ab1b2a50441]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:52 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:41:52 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:41:52 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.514s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e52353cc-5a2b-40cc-84d7-fe672680e394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a860a37-e880-4bb3-ae8f-92ed6210559c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:41:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:52 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:41:52 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:41:53 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 29 12:41:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.435s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:41:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:41:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:41:53 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:41:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:41:53 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 Sep 29 12:41:53 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:01 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529" returned: 0 in 8.059s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:42:01 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Converted 1024.00 MB image at 127.04 MB/s Sep 29 12:42:01 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 is being set with open permissions: ugo+rw Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:01 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 Sep 29 12:42:01 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:01 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" released by "_copy_volume_from_snapshot" :: held 9.364s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=200,cinder:UPDATE=206,cinder:INSERT=51,cinder:DELETE=16 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=177,cinder:INSERT=67,cinder:UPDATE=201,cinder:DELETE=18 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac-200b6f05-dbf7-4f76-b32a-e3a0e8019529" released by "_create_volume_from_snapshot" :: held 9.448s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.473s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.959s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating offline snapshot e82d1c90-836d-46a4-94bf-b73cb7039919 of volume 22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426b7a3-204a-4386-a01b-41d53bda4af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529', 'volume_size': 1, 'snapshot_id': '314a2192-ae95-4156-95d7-149d7ea7ebac'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18393f3-cb88-4054-ac01-b65e90d618b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e13f9f-37b9-418c-bf7c-6ae9b4407356]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Volume volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 (200b6f05-dbf7-4f76-b32a-e3a0e8019529): created successfully Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18393f3-cb88-4054-ac01-b65e90d618b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Flow 'volume_create_manager' (25adaffe-b309-4f49-a630-ff3d1a380d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2d2a64cf-6101-4477-a389-2b7372a32643 tempest-VolumesDeleteCascade-88783190 None] Created volume successfully. Sep 29 12:42:01 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:42:01 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-e52353cc-5a2b-40cc-84d7-fe672680e394-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-e52353cc-5a2b-40cc-84d7-fe672680e394-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Performing cascade delete. {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-314a2192-ae95-4156-95d7-149d7ea7ebac-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-314a2192-ae95-4156-95d7-149d7ea7ebac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Flow 'volume_create_manager' (5d8ca6a5-80a7-4269-9d1d-bb139041b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:02 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c3b2ea-379d-4489-bdc9-a912ac589983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.607s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c3b2ea-379d-4489-bdc9-a912ac589983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-62797287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5832c988-1cb7-48c2-9e65-953f1a3bae00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b601faff854faf8b70919fbbfe52cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:02Z,use_quota=True,user_id='daff98e879be4812a7207c4676e650f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6281e2dc-166e-4814-ba9c-45955c7c5a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:02 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 1G Sep 29 12:42:02 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6281e2dc-166e-4814-ba9c-45955c7c5a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559469a-b306-4287-b78a-c27bc1b0865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559469a-b306-4287-b78a-c27bc1b0865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5832c988-1cb7-48c2-9e65-953f1a3bae00', 'volume_name': 'volume-5832c988-1cb7-48c2-9e65-953f1a3bae00', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14ea1f3-417b-49d2-b3f4-72befa3b61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14ea1f3-417b-49d2-b3f4-72befa3b61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aa4446-0d2b-49a1-97d6-5b9dfb063a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Volume 5832c988-1cb7-48c2-9e65-953f1a3bae00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5832c988-1cb7-48c2-9e65-953f1a3bae00', 'volume_size': 1} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Deleting offline snapshot 314a2192-ae95-4156-95d7-149d7ea7ebac of volume e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] snapshot_file for this snap is: volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0bf62-5a77-4639-ac80-e22592488afb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:02 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:42:02 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:02 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 1G" returned: 0 in 0.472s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:02 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:02 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:02 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e52353cc-5a2b-40cc-84d7-fe672680e394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[096bfb1b-502a-40c0-b88c-3672991943f9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:02 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:42:02 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:03 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.359s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 is being set with open permissions: ugo+rw Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:03 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:03 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:03 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:03 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.622s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:03 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info Sep 29 12:42:03 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:03 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:42:03 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:03 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info" returned: 0 in 0.344s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info is being set with open permissions: ugo+rw Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:03 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info Sep 29 12:42:03 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:03 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.457s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:03 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac Sep 29 12:42:03 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:04 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.info" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-62797287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5832c988-1cb7-48c2-9e65-953f1a3bae00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b601faff854faf8b70919fbbfe52cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:02Z,use_quota=True,user_id='daff98e879be4812a7207c4676e650f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Creating volume 5832c988-1cb7-48c2-9e65-953f1a3bae00 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:04 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:04 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 1073741824 Sep 29 12:42:04 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c4780889-4d21-435a-8b53-d8967804b982 tempest-VolumesSnapshotTestJSON-1474533700 None] Create snapshot completed successfully Sep 29 12:42:04 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394.314a2192-ae95-4156-95d7-149d7ea7ebac" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-314a2192-ae95-4156-95d7-149d7ea7ebac" released by "_delete_snapshot" :: held 2.072s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" released by "delete_snapshot" :: held 2.169s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['346deade-8353-4174-bbc6-0b4813fe36b5', '0734e263-3fc2-4294-a4d4-7d366985c194', '85d801fa-055b-4e16-9a4f-ca27999a3037', '99802342-bf35-46e7-9415-94d8c7ce007d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:04 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 1073741824" returned: 0 in 0.505s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Delete snapshot completed successfully. Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-314a2192-ae95-4156-95d7-149d7ea7ebac-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Snapshots deleted, issuing volume delete {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:04 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 Sep 29 12:42:04 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[908ead36-55fe-454b-a94e-ac01afb6dfd2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:05 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:42:05 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:05 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00" returned: 0 in 0.344s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aa4446-0d2b-49a1-97d6-5b9dfb063a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5832c988-1cb7-48c2-9e65-953f1a3bae00', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baa0895-d0af-4fb7-bc51-d5112cf521ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Volume volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 (5832c988-1cb7-48c2-9e65-953f1a3bae00): created successfully Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baa0895-d0af-4fb7-bc51-d5112cf521ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Flow 'volume_create_manager' (5d8ca6a5-80a7-4269-9d1d-bb139041b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fb6af77a-76b7-4b8e-ab03-c22c64eb0983 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Created volume successfully. Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (cf4cc223-4a84-4d2a-9a57-0c3f5671821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d51e68-07d3-4bd7-808e-42255f270589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d51e68-07d3-4bd7-808e-42255f270589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564393692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1baa110-982c-4fe0-bd5f-46c4f3f21b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e82d1c90-836d-46a4-94bf-b73cb7039919,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:05Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee567d57-e441-4d5f-b2f6-72927040beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee567d57-e441-4d5f-b2f6-72927040beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bcd86d-edaf-49a1-84d3-1bfdf4ff259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bcd86d-edaf-49a1-84d3-1bfdf4ff259c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1baa110-982c-4fe0-bd5f-46c4f3f21b37', 'volume_name': 'volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37', 'volume_size': 2, 'snapshot_id': 'e82d1c90-836d-46a4-94bf-b73cb7039919'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a33a39-7451-449c-9e1f-64662e55a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a33a39-7451-449c-9e1f-64662e55a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cf806b-0698-4484-92d6-b8a9fa021d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume c1baa110-982c-4fe0-bd5f-46c4f3f21b37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37', 'volume_size': 2, 'snapshot_id': 'e82d1c90-836d-46a4-94bf-b73cb7039919'} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.532s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:05 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394 Sep 29 12:42:05 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating volume c1baa110-982c-4fe0-bd5f-46c4f3f21b37 from snapshot e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] snapshot: e82d1c90-836d-46a4-94bf-b73cb7039919, volume: c1baa110-982c-4fe0-bd5f-46c4f3f21b37, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b997277-fd8c-4037-a931-2e89d5dbac48]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:05 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:05 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:05 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e52353cc-5a2b-40cc-84d7-fe672680e394" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-e52353cc-5a2b-40cc-84d7-fe672680e394" released by "delete_volume" :: held 0.898s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['677c94a8-98c5-4725-8dba-d9ab06daaa95', '19dbd5f8-3510-4f1e-a1a1-3a6c622c5a37', '617b643c-02a4-4258-99c8-62898347cdaa', 'fedd924c-c82a-4d23-9caf-060c4c348370'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:05 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:05 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:06 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.428s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e02227-b331-4261-8b2a-c3b4789ee0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1ec8c5-bab7-4e2c-940f-46638a1dd048]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:06 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:42:06 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:06 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Deleted volume successfully. Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-22de3910-9a6b-4864-af8d-982b76aecc66 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-e52353cc-5a2b-40cc-84d7-fe672680e394-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:06 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:06 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 Sep 29 12:42:06 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-200b6f05-dbf7-4f76-b32a-e3a0e8019529-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-200b6f05-dbf7-4f76-b32a-e3a0e8019529-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c2028-f653-43b8-b282-59776e2656c9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:06 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 Sep 29 12:42:06 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:07 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529" returned: 0 in 0.685s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:07 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529 Sep 29 12:42:07 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Acquiring lock "cinder-5832c988-1cb7-48c2-9e65-953f1a3bae00-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "cinder-5832c988-1cb7-48c2-9e65-953f1a3bae00-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Acquiring lock "cinder-quobyte-5832c988-1cb7-48c2-9e65-953f1a3bae00" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "cinder-quobyte-5832c988-1cb7-48c2-9e65-953f1a3bae00" acquired by "delete_volume" :: waited 0.058s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:08 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc804a-8538-4dc9-a764-102085968ef4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-200b6f05-dbf7-4f76-b32a-e3a0e8019529" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-quobyte-200b6f05-dbf7-4f76-b32a-e3a0e8019529" released by "delete_volume" :: held 1.529s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:08 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 Sep 29 12:42:08 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Created reservations ['fe48ada6-3346-49a8-8790-c84a43e0f5b7', 'b48d2d60-5d3f-4ee8-a8ed-2df1892aa5cb', 'bef65a33-0b16-400c-b489-e4919699267b', 'ad9ced91-783e-4d4e-86de-f601e5469542'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:08 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:08 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:09 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00" returned: 0 in 0.865s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:09 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00 Sep 29 12:42:09 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:09 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Deleted volume successfully. Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3bcf20a0-c027-42aa-a5cd-52313931f367 tempest-VolumesDeleteCascade-88783190 None] Lock "cinder-200b6f05-dbf7-4f76-b32a-e3a0e8019529-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:09 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5832c988-1cb7-48c2-9e65-953f1a3bae00" returned: 0 in 0.885s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "cinder-quobyte-5832c988-1cb7-48c2-9e65-953f1a3bae00" released by "delete_volume" :: held 1.886s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Created reservations ['9bcec295-8583-442e-8b1d-34947c0f4ea4', '6a34addb-ac91-48d9-84e3-1cfe46b3c80d', '90768566-e5d7-4d39-a6a3-f95bddc18604', 'd49c6c71-b235-43a3-8679-717e7836d8c1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:10 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:10 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:10 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.587s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Deleted volume successfully. Sep 29 12:42:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fa9312de-b5d1-4459-90a0-9413b5059104 tempest-VolumeQuotasNegativeTestJSON-924427955 None] Lock "cinder-5832c988-1cb7-48c2-9e65-953f1a3bae00-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:15 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" returned: 0 in 9.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3, size 1024.00 MB, duration 9.42 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:42:15 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Converted 1024.00 MB image at 108.75 MB/s Sep 29 12:42:15 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 is being set with open permissions: ugo+rw Sep 29 12:42:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:15 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 Sep 29 12:42:15 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:16 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" returned: 0 in 0.362s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" released by "_copy_volume_from_snapshot" :: held 10.771s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" released by "_create_volume_from_snapshot" :: held 10.873s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.893s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cf806b-0698-4484-92d6-b8a9fa021d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37', 'volume_size': 2, 'snapshot_id': 'e82d1c90-836d-46a4-94bf-b73cb7039919'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e328af-42cb-49b8-bf8f-ecd872b539b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 (c1baa110-982c-4fe0-bd5f-46c4f3f21b37): created successfully Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e328af-42cb-49b8-bf8f-ecd872b539b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (cf4cc223-4a84-4d2a-9a57-0c3f5671821a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4d7db84a-d7cd-4599-82e8-0a2b12153376 tempest-VolumesSnapshotTestJSON-1474533700 None] Created volume successfully. Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-c1baa110-982c-4fe0-bd5f-46c4f3f21b37-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c1baa110-982c-4fe0-bd5f-46c4f3f21b37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081a994-f678-43e0-b348-f44b177b3f40]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:18 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 Sep 29 12:42:18 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:18 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" returned: 0 in 0.471s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:18 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37 Sep 29 12:42:18 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:18 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c1baa110-982c-4fe0-bd5f-46c4f3f21b37" released by "delete_volume" :: held 0.788s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['d344beca-c4f6-4a8d-bf05-2b3b199648f9', '517d5085-45fc-41be-8778-bdbc9d9f560b', '51e27de2-097c-4919-8faf-499f18d704d7', '660267eb-245f-4925-b7b1-2c6e5f63ad05'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:18 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:18 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-e82d1c90-836d-46a4-94bf-b73cb7039919-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-e82d1c90-836d-46a4-94bf-b73cb7039919-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Deleting offline snapshot e82d1c90-836d-46a4-94bf-b73cb7039919 of volume 22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] snapshot_file for this snap is: volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:42:19 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.452s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5157b7-6fb2-4495-bdd7-a52b9f28f2a7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Deleted volume successfully. Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5700369-724c-4cdd-b174-a373222d5012 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c1baa110-982c-4fe0-bd5f-46c4f3f21b37-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:19 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:19 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:19 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.545s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e02227-b331-4261-8b2a-c3b4789ee0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34e3728-5ddf-447f-b312-8b5290ed995a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Flow 'volume_create_manager' (94b52dd0-114a-4a3d-be09-0d93d7a29792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c2fd0b-1e45-4d06-8854-0d9dc378552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:19 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:42:19 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c2fd0b-1e45-4d06-8854-0d9dc378552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2128134036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74559c51-de95-4ccb-aaf4-21a6a9c0ada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc1817be7a43aca8732cfd913870ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:20Z,use_quota=True,user_id='8ad5f28d7ffd48e4b6aaf78a0eba1cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451a93b-fc60-43ff-b7ef-06b8e0d058a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451a93b-fc60-43ff-b7ef-06b8e0d058a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f67b093-f86b-4766-9008-89fb1f0795e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f67b093-f86b-4766-9008-89fb1f0795e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'volume_name': 'volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23fb3d-b7e1-48b3-a7ad-c64a40b23a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23fb3d-b7e1-48b3-a7ad-c64a40b23a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb16e5b3-60ad-42ce-ac14-5b75a808ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Volume 74559c51-de95-4ccb-aaf4-21a6a9c0ada8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'volume_size': 1} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2128134036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74559c51-de95-4ccb-aaf4-21a6a9c0ada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc1817be7a43aca8732cfd913870ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:20Z,use_quota=True,user_id='8ad5f28d7ffd48e4b6aaf78a0eba1cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Creating volume 74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:20 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:20 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 1073741824 Sep 29 12:42:20 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:20 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.709s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:20 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:20 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:20 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 1073741824" returned: 0 in 0.597s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:20 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:20 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:21 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.470s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:21 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919 Sep 29 12:42:21 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:21 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.332s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb16e5b3-60ad-42ce-ac14-5b75a808ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a874d98e-53ac-4d1b-8834-452f2690b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Volume volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 (74559c51-de95-4ccb-aaf4-21a6a9c0ada8): created successfully Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a874d98e-53ac-4d1b-8834-452f2690b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Flow 'volume_create_manager' (94b52dd0-114a-4a3d-be09-0d93d7a29792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-942eec92-6f42-42c8-adbe-99228762d70b tempest-VolumesCloneTest-1923814797 None] Created volume successfully. Sep 29 12:42:21 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3.e82d1c90-836d-46a4-94bf-b73cb7039919" returned: 0 in 0.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e82d1c90-836d-46a4-94bf-b73cb7039919" released by "_delete_snapshot" :: held 2.173s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" released by "delete_snapshot" :: held 2.211s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['6ee2123e-a268-4c57-9947-92286c12ea94', '448608bf-3cc9-4d80-a633-84ec84db7fb3', 'f0dae4b2-68e9-493a-aed1-f94bfdbfb6a9', 'f7e31c93-056f-42d1-ba89-30753f6cbbbf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Delete snapshot completed successfully. Sep 29 12:42:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab1f0b10-1b3a-4c3e-888f-c8c0f4d8da0d tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-e82d1c90-836d-46a4-94bf-b73cb7039919-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Flow 'volume_create_manager' (9f1242e4-65a5-47d5-9249-155bfbee5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ef81b3-d200-4fbe-a4b7-9557bb28001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-22e02227-b331-4261-8b2a-c3b4789ee0f3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ef81b3-d200-4fbe-a4b7-9557bb28001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1807430866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dc1817be7a43aca8732cfd913870ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=74559c51-de95-4ccb-aaf4-21a6a9c0ada8,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:22Z,use_quota=True,user_id='8ad5f28d7ffd48e4b6aaf78a0eba1cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104d9cce-8b14-4815-a99b-4f8d293a30dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104d9cce-8b14-4815-a99b-4f8d293a30dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b9263a-36d9-4d5b-af5b-921de52d02cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-22e02227-b331-4261-8b2a-c3b4789ee0f3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b9263a-36d9-4d5b-af5b-921de52d02cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e', 'volume_name': 'volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e', 'volume_size': 2, 'source_volid': '74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88366d0e-ff12-4785-ba22-f160d02368b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88366d0e-ff12-4785-ba22-f160d02368b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910b8634-e9b1-49b3-b700-d4f39a8a6f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Volume 6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e', 'volume_size': 2, 'source_volid': '74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'source_volstatus': 'available'} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:22 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Cloning volume 74559c51-de95-4ccb-aaf4-21a6a9c0ada8 to volume 6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Creating offline snapshot 67612db1-f20d-4874-acca-57b7678054e1 of volume 74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae5b943-1df1-45f5-9a7c-dfbfaffffbb7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b869fd4-391f-4c53-93a7-05c4b006a4fe]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:23 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:42:23 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:23 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:23 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Flow 'volume_create_manager' (262a7937-a4e8-4fb1-997b-b9c55513c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38966385-2fe4-4c50-aebf-89a103a142e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38966385-2fe4-4c50-aebf-89a103a142e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-155745294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a806723-0aac-4aa3-b76e-60dd650019ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2128ea6fde413cba55d2bf9e427c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:23Z,use_quota=True,user_id='9ab7378d97c64bbd9cd18a22c9935dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8830e80d-d5ba-4a9d-b310-dbdc2fdc1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8830e80d-d5ba-4a9d-b310-dbdc2fdc1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7240cb9-6daa-4fbe-ba90-d9a260d7d148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7240cb9-6daa-4fbe-ba90-d9a260d7d148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a806723-0aac-4aa3-b76e-60dd650019ed', 'volume_name': 'volume-0a806723-0aac-4aa3-b76e-60dd650019ed', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847156fe-b7ba-49ae-b2a2-67233717058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847156fe-b7ba-49ae-b2a2-67233717058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aba2513-2e4a-458f-aeef-287a08d1a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Volume 0a806723-0aac-4aa3-b76e-60dd650019ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a806723-0aac-4aa3-b76e-60dd650019ed', 'volume_size': 1} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:23 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.511s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:23 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.512s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:23 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 1G Sep 29 12:42:23 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:23 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3 Sep 29 12:42:23 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (8acfb5e7-5bbe-4cc8-9fb4-45a62b374197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417dd0c3-bde9-4fc7-af6b-55e9827b4d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417dd0c3-bde9-4fc7-af6b-55e9827b4d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1631925638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db41199-7941-4067-a211-3d1165b3d929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:23Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc28654-5243-4ef4-8e72-3001cf04ebac),volume_type_id=0dc28654-5243-4ef4-8e72-3001cf04ebac)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c264b1f0-2511-4d12-8f88-44aab7ed3a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c264b1f0-2511-4d12-8f88-44aab7ed3a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37394a-4124-4d76-9399-52e42c8f2d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37394a-4124-4d76-9399-52e42c8f2d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db41199-7941-4067-a211-3d1165b3d929', 'volume_name': 'volume-0db41199-7941-4067-a211-3d1165b3d929', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ba5db7-02eb-45a2-994e-25b843573d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ba5db7-02eb-45a2-994e-25b843573d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e96f2f-a979-407f-a2aa-129e8032bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Volume 0db41199-7941-4067-a211-3d1165b3d929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db41199-7941-4067-a211-3d1165b3d929', 'volume_size': 1} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:23 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-22e02227-b331-4261-8b2a-c3b4789ee0f3" returned: 0 in 0.349s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-22e02227-b331-4261-8b2a-c3b4789ee0f3" released by "delete_volume" :: held 0.976s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['1a6cf394-1278-4704-8cff-35d2d4cd907e', 'fac3ec83-8dc8-4f31-b6e1-9cfab1350446', 'cdf8d66e-25a9-4925-a97b-a1f41c4f1c20', 'be02b6b8-7c17-47d8-9a87-e240efff99ca'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (1cbf43fa-766b-47c4-95ca-e0fd7a2d97ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3916357f-cad1-4fd6-8c39-564c89022854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 1G" returned: 0 in 0.633s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3916357f-cad1-4fd6-8c39-564c89022854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-191323541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:24Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ba21e06-6d06-4899-b0a7-8a21249988e7),volume_type_id=1ba21e06-6d06-4899-b0a7-8a21249988e7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:24 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8611952-1472-4e35-81ed-c12557a09cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8611952-1472-4e35-81ed-c12557a09cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d43ceec-57ef-47ae-832d-839e0c29b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d43ceec-57ef-47ae-832d-839e0c29b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a', 'volume_name': 'volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cff1ebb-7d78-4ea0-9cb6-738a6f00f69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cff1ebb-7d78-4ea0-9cb6-738a6f00f69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ad29e-b8c8-40ba-b7cb-7a27f8450ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Volume a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a', 'volume_size': 1} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:24 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:24 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:24 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:24 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.346s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.501s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:24 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 is being set with open permissions: ugo+rw Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Deleted volume successfully. Sep 29 12:42:24 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:24 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fc4e133f-4ed3-4f94-b58e-ad143f543b91 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-22e02227-b331-4261-8b2a-c3b4789ee0f3-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (c3a90889-5ef8-4671-a9a9-ceb4f36954fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58776f6-6994-4efa-9c57-ddf0e3b1de41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.327s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58776f6-6994-4efa-9c57-ddf0e3b1de41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-599148065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe1e0b-2ec7-47c4-be08-8e1df946ae30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:25Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4fc0cc-8661-486c-a224-f8e55814b36c),volume_type_id=ca4fc0cc-8661-486c-a224-f8e55814b36c)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d2a0f-d882-40ec-b09c-4fd0358eb37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d2a0f-d882-40ec-b09c-4fd0358eb37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e48f66c-2338-46a4-9f44-77e27fe7ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (800f4da7-8312-43ca-af31-734b6d6e3b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a1eed7-9a4d-4b43-8760-a92e51c6e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a1eed7-9a4d-4b43-8760-a92e51c6e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1072382588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ab52a2-49a6-4550-b427-a55faecdfe78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:25Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info Sep 29 12:42:24 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f795286e-7983-47da-b65f-4dd96d79fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f795286e-7983-47da-b65f-4dd96d79fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d883f3-f723-4a62-80ca-518f7c6cb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d883f3-f723-4a62-80ca-518f7c6cb121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ab52a2-49a6-4550-b427-a55faecdfe78', 'volume_name': 'volume-e8ab52a2-49a6-4550-b427-a55faecdfe78', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb678d54-ade1-4495-9825-92532837d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb678d54-ade1-4495-9825-92532837d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d087bb6-a742-496e-aa47-0cde01aea5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume e8ab52a2-49a6-4550-b427-a55faecdfe78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ab52a2-49a6-4550-b427-a55faecdfe78', 'volume_size': 1} Sep 29 12:42:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:25 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:25 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info is being set with open permissions: ugo+rw Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:25 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info Sep 29 12:42:25 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e48f66c-2338-46a4-9f44-77e27fe7ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3fe1e0b-2ec7-47c4-be08-8e1df946ae30', 'volume_name': 'volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30', 'volume_size': 1, 'image_id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1952152522', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6712111df9d4112812a817db7ecb157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'created_at': datetime.datetime(2026, 9, 29, 10, 42, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf29186d-5a27-416a-86a9-73b67bef38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf29186d-5a27-416a-86a9-73b67bef38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f65ad4e-fecf-4c91-935e-1524059bf374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30', 'volume_size': 1, 'image_id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1952152522', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6712111df9d4112812a817db7ecb157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'created_at': datetime.datetime(2026, 9, 29, 10, 42, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744/file', 'properties': {}}, 'image_service': } Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Trying to clone a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 from image b7f2927d-261a-4f3a-bbf1-80fe7db39744 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:42:25 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.info" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] snapshot: 67612db1-f20d-4874-acca-57b7678054e1, volume: 6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[122fe3ed-542f-4083-b946-c93953e4820c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:25 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:25 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:25 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a95322-8cd8-4d5a-b4e3-aa39f1540537]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:26 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:26 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:26 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:42:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:42:26 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:42:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:26 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e Sep 29 12:42:26 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:29 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD, size 20.69 MB, duration 4.19 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:42:29 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Image download 20.69 MB at 4.94 MB/s Sep 29 12:42:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c0e14-574a-4cb3-8466-109bdabe9974]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:29 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD Sep 29 12:42:29 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:29 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Temporary image b7f2927d-261a-4f3a-bbf1-80fe7db39744 is fetched for user a8c05e4f39df40198b476d26eb307771. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ccd415-0193-49ba-b0d5-dfc45fbb34a1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:30 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:30 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:30 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD Sep 29 12:42:30 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:30 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:30 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.463s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:42:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:42:33 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" returned: 0 in 6.719s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:42:33 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Converted 1024.00 MB image at 152.39 MB/s Sep 29 12:42:33 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e is being set with open permissions: ugo+rw Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:33 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e Sep 29 12:42:33 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:33 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" returned: 0 in 0.232s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" released by "_copy_volume_from_snapshot" :: held 7.792s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-quobyte-67612db1-f20d-4874-acca-57b7678054e1" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-67612db1-f20d-4874-acca-57b7678054e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Deleting offline snapshot 67612db1-f20d-4874-acca-57b7678054e1 of volume 74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] snapshot_file for this snap is: volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b072c064-f1da-4ffb-a3bb-ef07b48c6f8b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:33 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:33 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:33 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.359s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5129454-9755-4188-98fa-66a8299263fc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:33 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:33 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:34 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.521s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:34 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:34 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:34 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.328s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:34 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1 Sep 29 12:42:34 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:34 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8.67612db1-f20d-4874-acca-57b7678054e1" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-67612db1-f20d-4874-acca-57b7678054e1" released by "_delete_snapshot" :: held 1.553s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.185s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.782s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-155745294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a806723-0aac-4aa3-b76e-60dd650019ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2128ea6fde413cba55d2bf9e427c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:23Z,use_quota=True,user_id='9ab7378d97c64bbd9cd18a22c9935dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Creating volume 0a806723-0aac-4aa3-b76e-60dd650019ed {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:34 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed 1073741824 Sep 29 12:42:34 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910b8634-e9b1-49b3-b700-d4f39a8a6f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e', 'volume_size': 2, 'source_volid': '74559c51-de95-4ccb-aaf4-21a6a9c0ada8', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb7b588-8380-4452-a75a-a4a299f7c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Volume volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e (6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e): created successfully Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb7b588-8380-4452-a75a-a4a299f7c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Flow 'volume_create_manager' (9f1242e4-65a5-47d5-9249-155bfbee5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9956932d-4902-4a95-8a69-c5fa69e0a40a tempest-VolumesCloneTest-1923814797 None] Created volume successfully. Sep 29 12:42:35 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed 1073741824" returned: 0 in 0.434s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:35 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed Sep 29 12:42:35 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:35 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed" returned: 0 in 0.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.067s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1631925638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db41199-7941-4067-a211-3d1165b3d929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:23Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc28654-5243-4ef4-8e72-3001cf04ebac),volume_type_id=0dc28654-5243-4ef4-8e72-3001cf04ebac)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Creating volume 0db41199-7941-4067-a211-3d1165b3d929 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:35 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 1073741824 Sep 29 12:42:35 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aba2513-2e4a-458f-aeef-287a08d1a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a806723-0aac-4aa3-b76e-60dd650019ed', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d4ca61-8fd8-47be-b6fe-69cbf2590a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Volume volume-0a806723-0aac-4aa3-b76e-60dd650019ed (0a806723-0aac-4aa3-b76e-60dd650019ed): created successfully Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d4ca61-8fd8-47be-b6fe-69cbf2590a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Flow 'volume_create_manager' (262a7937-a4e8-4fb1-997b-b9c55513c949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5ec6a341-9a08-44ff-ad94-fb2ae0cc5367 tempest-VolumesServicesTestJSON-2020289746 None] Created volume successfully. Sep 29 12:42:36 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 1073741824" returned: 0 in 0.438s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 Sep 29 12:42:36 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35cb1e0-609c-459f-963f-b79b03b99bcb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e Sep 29 12:42:36 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Acquiring lock "cinder-0a806723-0aac-4aa3-b76e-60dd650019ed-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:36 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.312s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-191323541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:24Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ba21e06-6d06-4899-b0a7-8a21249988e7),volume_type_id=1ba21e06-6d06-4899-b0a7-8a21249988e7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Creating volume a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e96f2f-a979-407f-a2aa-129e8032bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db41199-7941-4067-a211-3d1165b3d929', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56346be-538a-4d30-a8ed-8a4083bca78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:36 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a 1073741824 Sep 29 12:42:36 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "cinder-0a806723-0aac-4aa3-b76e-60dd650019ed-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Volume volume-0db41199-7941-4067-a211-3d1165b3d929 (0db41199-7941-4067-a211-3d1165b3d929): created successfully Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56346be-538a-4d30-a8ed-8a4083bca78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (8acfb5e7-5bbe-4cc8-9fb4-45a62b374197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e0bd418c-33b0-41c6-9bda-16d47d85a88f tempest-TestInstancesWithCinderVolumes-188249689 None] Created volume successfully. Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Acquiring lock "cinder-quobyte-0a806723-0aac-4aa3-b76e-60dd650019ed" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "cinder-quobyte-0a806723-0aac-4aa3-b76e-60dd650019ed" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e2bc3-47fa-4980-8186-796f38d7c015]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e Sep 29 12:42:36 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:36 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed Sep 29 12:42:36 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:36 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a 1073741824" returned: 0 in 0.485s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e" released by "delete_volume" :: held 0.735s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:36 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a Sep 29 12:42:37 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Created reservations ['5ea18a54-5017-4f37-855e-ef521f6e1c2c', '572a89c2-890d-4185-8149-6438a6597dcd', '59cc210d-c615-4137-95ed-bf46251d527e', '7cf61eea-4c6b-4bc8-8073-52c41cc7201d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:37 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed Sep 29 12:42:37 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:37 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0a806723-0aac-4aa3-b76e-60dd650019ed" returned: 0 in 0.258s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "cinder-quobyte-0a806723-0aac-4aa3-b76e-60dd650019ed" released by "delete_volume" :: held 0.708s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:37 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" returned: 0 in 0.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.307s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1072382588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ab52a2-49a6-4550-b427-a55faecdfe78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:25Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating volume e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:37 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-74559c51-de95-4ccb-aaf4-21a6a9c0ada8-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:37 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:37 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 1073741824 Sep 29 12:42:37 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ad29e-b8c8-40ba-b7cb-7a27f8450ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225b72f6-f035-4542-9d36-cda078cc6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Volume volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a (a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a): created successfully Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225b72f6-f035-4542-9d36-cda078cc6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (1cbf43fa-766b-47c4-95ca-e0fd7a2d97ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Deleted volume successfully. Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-74559c51-de95-4ccb-aaf4-21a6a9c0ada8-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-02b88692-9a0b-4435-ab1a-bb68a25bf6e8 tempest-TestInstancesWithCinderVolumes-188249689 None] Created volume successfully. Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5f49bb7-a057-456f-8986-57360dc933a1 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-6c7fc6d3-a92b-42c1-8be0-f6c2dddc675e-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Created reservations ['939e0cdd-d229-4ac2-acb7-f553f3987356', 'e88bfabf-a63f-48e5-b759-ab013a21601f', '70d4e3a8-ae22-4232-93dc-48f1ed0cf171', 'dcc47ce0-ec98-4b91-9822-ddb3d0a0d46f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "cinder-quobyte-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7a89b-994c-44cc-97ac-e74c85321298]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:37 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:37 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 1073741824" returned: 0 in 0.500s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:37 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:42:37 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:37 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Deleted volume successfully. Sep 29 12:42:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e5692df-fccd-4521-a6f0-b6c4fbfececd tempest-VolumesServicesTestJSON-2020289746 None] Lock "cinder-0a806723-0aac-4aa3-b76e-60dd650019ed-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:38 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:38 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8 Sep 29 12:42:38 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:38 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.467s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-599148065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe1e0b-2ec7-47c4-be08-8e1df946ae30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6712111df9d4112812a817db7ecb157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:25Z,use_quota=True,user_id='a8c05e4f39df40198b476d26eb307771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4fc0cc-8661-486c-a224-f8e55814b36c),volume_type_id=ca4fc0cc-8661-486c-a224-f8e55814b36c)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Creating volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d087bb6-a742-496e-aa47-0cde01aea5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ab52a2-49a6-4550-b427-a55faecdfe78', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:38 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1073741824 Sep 29 12:42:38 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313c9c85-a842-4a50-aaac-d3ff13546d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 (e8ab52a2-49a6-4550-b427-a55faecdfe78): created successfully Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313c9c85-a842-4a50-aaac-d3ff13546d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (800f4da7-8312-43ca-af31-734b6d6e3b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-35cd4f95-a4bb-4196-bf46-cee4b5980ae9 tempest-VolumesSnapshotTestJSON-1474533700 None] Created volume successfully. Sep 29 12:42:38 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-quobyte-74559c51-de95-4ccb-aaf4-21a6a9c0ada8" released by "delete_volume" :: held 0.717s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Created reservations ['8fad235f-0a31-4c6e-938e-d4719ca4a202', 'f6de02c2-0af5-40e4-9b4d-320bdd3ca3d1', '51e75b8a-c55e-4749-b880-7d1e6257a93a', 'dd2e9bca-86bd-4b70-b395-620038849ad4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:38 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:38 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:38 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1073741824" returned: 0 in 0.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:38 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 Sep 29 12:42:38 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.300s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Deleted volume successfully. Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-37a4ae94-000d-44aa-a180-3aab7f5e0a90 tempest-VolumesCloneTest-1923814797 None] Lock "cinder-74559c51-de95-4ccb-aaf4-21a6a9c0ada8-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:38 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Attempting download of b7f2927d-261a-4f3a-bbf1-80fe7db39744 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}])) to volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea4fd5-4bb6-46c0-94a3-aa5b5b79e395]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:39 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe Sep 29 12:42:39 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Creating offline snapshot a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 of volume e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c738f7b-45d0-46de-8981-17bbf247dac6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:39 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:42:39 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:39 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:39 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe Sep 29 12:42:39 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:39 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:39 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 1G Sep 29 12:42:39 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:39 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe" returned: 1 in 0.391s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7f2927d-261a-4f3a-bbf1-80fe7db39744_f846lzqe' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aad94e8-4565-49d7-a964-4535fc927f40]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:40 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD Sep 29 12:42:40 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:40 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 1G" returned: 0 in 0.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:40 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:40 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:40 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] b7f2927d-261a-4f3a-bbf1-80fe7db39744 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:40 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 Sep 29 12:42:40 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:40 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.352s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:40 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 is being set with open permissions: ugo+rw Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:40 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:40 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:40 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.346s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:41 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info Sep 29 12:42:41 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:41 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info" returned: 0 in 0.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:41 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info is being set with open permissions: ugo+rw Sep 29 12:42:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:41 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info Sep 29 12:42:41 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:41 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.info" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5962f101-c002-4520-92e0-768febc88b3c tempest-VolumesSnapshotTestJSON-1474533700 None] Create snapshot completed successfully Sep 29 12:42:42 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" returned: 0 in 2.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:42 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7f2927d-261a-4f3a-bbf1-80fe7db39744_x1rhbn91devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:42:42 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Converted 112.00 MB image at 47.52 MB/s Sep 29 12:42:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:42 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1G Sep 29 12:42:42 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:43 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 1G" returned: 0 in 0.460s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Downloaded image b7f2927d-261a-4f3a-bbf1-80fe7db39744 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}])) to volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Temporary image b7f2927d-261a-4f3a-bbf1-80fe7db39744 for user a8c05e4f39df40198b476d26eb307771 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Marking volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Copying metadata from image b7f2927d-261a-4f3a-bbf1-80fe7db39744 to a3fe1e0b-2ec7-47c4-be08-8e1df946ae30. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Creating volume glance metadata for volume a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 backed by image b7f2927d-261a-4f3a-bbf1-80fe7db39744 with: {'image_id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'image_name': 'tempest-scenario-img--1952152522', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (1b3c24bf-f2a1-480e-81e2-b2c8727e16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfea5dd1-d860-4ac9-88f5-1a5c0dbb2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfea5dd1-d860-4ac9-88f5-1a5c0dbb2a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545259795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a021c0-385c-48a7-8cdc-a9638bbc6875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ffda4702c64b92b0249d8a05d636fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:43Z,use_quota=True,user_id='274bb2a8795e4edea8b005c1af0b0184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebee5cc-b12f-42ba-9daa-436c15767e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebee5cc-b12f-42ba-9daa-436c15767e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb047ef-4381-4f1b-9288-4dacb9333be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb047ef-4381-4f1b-9288-4dacb9333be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3a021c0-385c-48a7-8cdc-a9638bbc6875', 'volume_name': 'volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875', 'volume_size': 1, 'snapshot_id': 'a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627ddb7b-f07c-4c50-beac-c63943f9b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627ddb7b-f07c-4c50-beac-c63943f9b20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0705f7d-c44b-4e7f-96ab-4a799cf196c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume c3a021c0-385c-48a7-8cdc-a9638bbc6875: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875', 'volume_size': 1, 'snapshot_id': 'a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18'} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-c3a021c0-385c-48a7-8cdc-a9638bbc6875" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-c3a021c0-385c-48a7-8cdc-a9638bbc6875" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating volume c3a021c0-385c-48a7-8cdc-a9638bbc6875 from snapshot a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] snapshot: a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18, volume: c3a021c0-385c-48a7-8cdc-a9638bbc6875, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f65ad4e-fecf-4c91-935e-1524059bf374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30', 'volume_size': 1, 'image_id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1952152522', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6712111df9d4112812a817db7ecb157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7f2927d-261a-4f3a-bbf1-80fe7db39744', 'created_at': datetime.datetime(2026, 9, 29, 10, 42, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7f2927d-261a-4f3a-bbf1-80fe7db39744/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5051b345-ca43-4a8f-b17a-fc7c808b809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c30e5-f18f-4df0-9061-8f9da8997b27]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Volume volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 (a3fe1e0b-2ec7-47c4-be08-8e1df946ae30): created successfully Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5051b345-ca43-4a8f-b17a-fc7c808b809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Flow 'volume_create_manager' (c3a90889-5ef8-4671-a9a9-ceb4f36954fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2b3f013c-f9a2-4eed-8766-bd7246d3f74b tempest-TestInstancesWithCinderVolumes-188249689 None] Created volume successfully. Sep 29 12:42:43 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:43 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (67d939d8-bafd-4955-97e0-b2bebff57e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212df85-2dce-460a-b3c4-065d5ba8fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212df85-2dce-460a-b3c4-065d5ba8fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-462931974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8edb9a-8297-4a98-8f6f-1776b240b780,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:44Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21287526-0d93-44d0-aaed-17dfee82f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21287526-0d93-44d0-aaed-17dfee82f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4852805b-cee9-43fa-aca0-7fe8b1e63111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4852805b-cee9-43fa-aca0-7fe8b1e63111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8edb9a-8297-4a98-8f6f-1776b240b780', 'volume_name': 'volume-8a8edb9a-8297-4a98-8f6f-1776b240b780', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb290bb-5340-4ea6-bbf8-a49c9a0a058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb290bb-5340-4ea6-bbf8-a49c9a0a058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085f41c5-9bb7-417b-a150-aae20201831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Volume 8a8edb9a-8297-4a98-8f6f-1776b240b780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8edb9a-8297-4a98-8f6f-1776b240b780', 'volume_size': 1} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:43 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.404s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ab52a2-49a6-4550-b427-a55faecdfe78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e0efc-f231-4a52-891c-f0618f785dbd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:43 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:42:43 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:44 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:42:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:42:44 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:42:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:44 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 Sep 29 12:42:44 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-492cc949-3399-4bbb-8104-09d0a2e1dc84 req-27e8a68b-735e-467a-a16f-647e866a2358 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:52 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875" returned: 0 in 8.634s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:52 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:42:52 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Converted 1024.00 MB image at 118.58 MB/s Sep 29 12:42:52 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 is being set with open permissions: ugo+rw Sep 29 12:42:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:52 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 Sep 29 12:42:52 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:53 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875" returned: 0 in 0.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" released by "_copy_volume_from_snapshot" :: held 9.871s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-c3a021c0-385c-48a7-8cdc-a9638bbc6875" released by "_create_volume_from_snapshot" :: held 9.948s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.971s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.524s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-462931974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8edb9a-8297-4a98-8f6f-1776b240b780,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:44Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Creating volume 8a8edb9a-8297-4a98-8f6f-1776b240b780 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:53 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:53 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 1073741824 Sep 29 12:42:53 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0705f7d-c44b-4e7f-96ab-4a799cf196c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875', 'volume_size': 1, 'snapshot_id': 'a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597d6a7-5202-4500-b77f-cbf8875c12ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Volume volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 (c3a021c0-385c-48a7-8cdc-a9638bbc6875): created successfully Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597d6a7-5202-4500-b77f-cbf8875c12ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Flow 'volume_create_manager' (1b3c24bf-f2a1-480e-81e2-b2c8727e16fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dc153199-9432-4b68-adda-8f587f06d762 tempest-VolumesSnapshotTestJSON-1474533700 None] Created volume successfully. Sep 29 12:42:53 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 1073741824" returned: 0 in 0.589s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:53 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 Sep 29 12:42:53 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:54 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780" returned: 0 in 0.330s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-492cc949-3399-4bbb-8104-09d0a2e1dc84 req-27e8a68b-735e-467a-a16f-647e866a2358 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.440s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085f41c5-9bb7-417b-a150-aae20201831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8edb9a-8297-4a98-8f6f-1776b240b780', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de767ac7-0ba1-451e-abe2-773cf6e29f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-492cc949-3399-4bbb-8104-09d0a2e1dc84 req-27e8a68b-735e-467a-a16f-647e866a2358 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Volume volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 (8a8edb9a-8297-4a98-8f6f-1776b240b780): created successfully Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de767ac7-0ba1-451e-abe2-773cf6e29f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (67d939d8-bafd-4955-97e0-b2bebff57e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5302afd2-98ac-4d9c-9ca8-ba031d1bbcf5 tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-492cc949-3399-4bbb-8104-09d0a2e1dc84 req-27e8a68b-735e-467a-a16f-647e866a2358 tempest-TestInstancesWithCinderVolumes-188249689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '447fe717-b9d2-4190-9c92-5103d3adcfdd', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-c3a021c0-385c-48a7-8cdc-a9638bbc6875-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c3a021c0-385c-48a7-8cdc-a9638bbc6875-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-492cc949-3399-4bbb-8104-09d0a2e1dc84 req-27e8a68b-735e-467a-a16f-647e866a2358 tempest-TestInstancesWithCinderVolumes-188249689 None] attachment_update completed successfully. Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b80d0-0b8d-4fd5-a996-2eca2b40f75c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:54 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 Sep 29 12:42:54 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:55 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875" returned: 0 in 0.539s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:55 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875 Sep 29 12:42:55 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:55 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c3a021c0-385c-48a7-8cdc-a9638bbc6875" returned: 0 in 0.324s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-c3a021c0-385c-48a7-8cdc-a9638bbc6875" released by "delete_volume" :: held 0.975s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['6437d7c8-800c-474a-860b-8bc3d8d7cf9e', '309c590b-108f-44ab-85ca-350ed65c6165', 'dde734e6-aceb-4372-ab2f-df14c86c5fce', 'aa6938b4-5c4a-40ba-892c-8f7b30246545'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:56 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:42:56 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:56 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.702s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:42:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Deleted volume successfully. Sep 29 12:42:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-67703e31-5e90-41df-89af-0151f1a8e585 tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-c3a021c0-385c-48a7-8cdc-a9638bbc6875-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (0d6c2a30-d960-44b0-beac-8ffb191e3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee17eca1-bcec-4943-a389-427c3fc312b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee17eca1-bcec-4943-a389-427c3fc312b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-265365950',display_name='tempest-VolumesGetTest-Volume-1751909525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf61069c-4fc6-41dc-9d96-e708fa2ca832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:57Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62422da7-aa75-4cfe-b576-ba49b8b1f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62422da7-aa75-4cfe-b576-ba49b8b1f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dbb324-f62c-4a46-9f5d-a6d4d021f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dbb324-f62c-4a46-9f5d-a6d4d021f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf61069c-4fc6-41dc-9d96-e708fa2ca832', 'volume_name': 'volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d71384-fa63-41fa-ae1f-2304dafe5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d71384-fa63-41fa-ae1f-2304dafe5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ca6b26-90a2-4982-b51a-fe8ac854a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Volume bf61069c-4fc6-41dc-9d96-e708fa2ca832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832', 'volume_size': 1} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-265365950',display_name='tempest-VolumesGetTest-Volume-1751909525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf61069c-4fc6-41dc-9d96-e708fa2ca832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:57Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Creating volume bf61069c-4fc6-41dc-9d96-e708fa2ca832 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:57 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 1073741824 Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:57 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Deleting offline snapshot a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 of volume e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] snapshot_file for this snap is: volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae100489-38bc-4bab-9538-7f0dac13f22c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:57 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:57 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (e47afdfd-4fbf-4704-975a-98462fb56de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5834db6-754a-4fc1-9760-b0e1f3ce4142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5834db6-754a-4fc1-9760-b0e1f3ce4142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550227355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d4ce98-06ea-4660-8630-597e93b14d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:58Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486f6df6-c2c6-4a75-98e3-cee6c8ef52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486f6df6-c2c6-4a75-98e3-cee6c8ef52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43853e25-5089-4dc4-b274-186244cf906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43853e25-5089-4dc4-b274-186244cf906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d4ce98-06ea-4660-8630-597e93b14d4d', 'volume_name': 'volume-43d4ce98-06ea-4660-8630-597e93b14d4d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2899764a-f405-4388-811a-c7fd4db14eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2899764a-f405-4388-811a-c7fd4db14eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b613a9-3cc5-421f-a1bc-ff7d8518831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Volume 43d4ce98-06ea-4660-8630-597e93b14d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d4ce98-06ea-4660-8630-597e93b14d4d', 'volume_size': 1} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:57 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 1073741824" returned: 0 in 0.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:57 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.489s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ab52a2-49a6-4550-b427-a55faecdfe78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5711879-3ff2-4cd9-b705-9cdecb109e80]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:57 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 Sep 29 12:42:57 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:58 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:42:58 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:58 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550227355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d4ce98-06ea-4660-8630-597e93b14d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:58Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Creating volume 43d4ce98-06ea-4660-8630-597e93b14d4d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:42:58 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ca6b26-90a2-4982-b51a-fe8ac854a47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d103913a-1351-4ac9-97fc-1feddece87a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:58 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d 1073741824 Sep 29 12:42:58 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Volume volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 (bf61069c-4fc6-41dc-9d96-e708fa2ca832): created successfully Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d103913a-1351-4ac9-97fc-1feddece87a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (0d6c2a30-d960-44b0-beac-8ffb191e3910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3a2bd3db-c71b-4d78-a6d7-bd1dddbe5619 tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:42:58 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.755s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:58 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:58 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:58 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d 1073741824" returned: 0 in 0.666s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:59 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d Sep 29 12:42:59 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:59 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:59 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18 Sep 29 12:42:59 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:42:59 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d" returned: 0 in 0.417s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b613a9-3cc5-421f-a1bc-ff7d8518831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d4ce98-06ea-4660-8630-597e93b14d4d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436c5436-9931-4c97-9248-bb83a2eb4d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:42:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Volume volume-43d4ce98-06ea-4660-8630-597e93b14d4d (43d4ce98-06ea-4660-8630-597e93b14d4d): created successfully Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436c5436-9931-4c97-9248-bb83a2eb4d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (e47afdfd-4fbf-4704-975a-98462fb56de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:42:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-06d5819d-7691-4234-9e20-e960fec6af1f tempest-VolumesListAdminTestJSON-36570670 None] Created volume successfully. Sep 29 12:42:59 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78.a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" returned: 0 in 0.422s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18" released by "_delete_snapshot" :: held 2.229s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" released by "delete_snapshot" :: held 2.262s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-bf61069c-4fc6-41dc-9d96-e708fa2ca832-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "cinder-bf61069c-4fc6-41dc-9d96-e708fa2ca832-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-bf61069c-4fc6-41dc-9d96-e708fa2ca832" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['0b79f6ce-cb6a-4d7a-a87c-173c3ff211dc', 'f815c20e-3bd4-4f87-bbae-1ea57635f640', 'd1a2a769-5df4-4f37-9d69-cd5bf2600de2', '2d18f213-5198-4a2e-887c-f23a468f4aad'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-bf61069c-4fc6-41dc-9d96-e708fa2ca832" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8bced0-d019-4a15-92d5-98ca66b9d22b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:42:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Delete snapshot completed successfully. Sep 29 12:42:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5e0c0f73-ecaa-4693-beca-e7aafb1627ca tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-a23a94a5-f4e9-4f5b-9f78-fcc9f28f9b18-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:00 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 Sep 29 12:43:00 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:00 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832" returned: 0 in 0.714s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:00 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832 Sep 29 12:43:00 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-e8ab52a2-49a6-4550-b427-a55faecdfe78-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-e8ab52a2-49a6-4550-b427-a55faecdfe78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (147528ff-e0b4-4013-aad3-dae4c87ed917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a5502-07b0-4903-8f2a-9b4781741eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a5502-07b0-4903-8f2a-9b4781741eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-992139509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa416c8-98aa-47a7-aab0-8ba780d62f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:01Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b925751b-f218-445f-b1b5-45bbf99a5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b925751b-f218-445f-b1b5-45bbf99a5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d91f6d0-0600-4ac9-8f06-d9706e44e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d91f6d0-0600-4ac9-8f06-d9706e44e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa416c8-98aa-47a7-aab0-8ba780d62f95', 'volume_name': 'volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e826953-c4aa-4bd2-8083-f64ef0215152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e826953-c4aa-4bd2-8083-f64ef0215152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebac709-cb56-4d48-9520-ff2055e45ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Volume 6fa416c8-98aa-47a7-aab0-8ba780d62f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95', 'volume_size': 1} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-992139509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa416c8-98aa-47a7-aab0-8ba780d62f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:01Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Creating volume 6fa416c8-98aa-47a7-aab0-8ba780d62f95 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" acquired by "delete_volume" :: waited 0.127s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:01 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 1073741824 Sep 29 12:43:01 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae983149-dd62-4b9c-a431-81228a554c17]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:01 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bf61069c-4fc6-41dc-9d96-e708fa2ca832" returned: 0 in 0.609s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-bf61069c-4fc6-41dc-9d96-e708fa2ca832" released by "delete_volume" :: held 1.406s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:01 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:43:01 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Created reservations ['f82b5d4e-f2f8-447d-bd63-b3b75c6194a6', 'ace3c134-c65e-4f17-9353-2951a5baa868', '7636d904-9168-461b-9536-e6953ad2085d', 'cb072f8a-4ce9-49cb-b4ac-0624ffbb2f1e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:01 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:01 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:01 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.574s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:01 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78 Sep 29 12:43:01 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:01 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 1073741824" returned: 0 in 0.958s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:01 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:01 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=114,cinder:INSERT=45,cinder:UPDATE=149,cinder:DELETE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=144,cinder:DELETE=15,cinder:SELECT=128,cinder:INSERT=34 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.500s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c92c5469-b67f-40d6-8ada-83ab6810020a tempest-VolumesGetTest-1203079796 None] Lock "cinder-bf61069c-4fc6-41dc-9d96-e708fa2ca832-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:02 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 Sep 29 12:43:02 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-8a8edb9a-8297-4a98-8f6f-1776b240b780-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "cinder-8a8edb9a-8297-4a98-8f6f-1776b240b780-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-8a8edb9a-8297-4a98-8f6f-1776b240b780" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-8a8edb9a-8297-4a98-8f6f-1776b240b780" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b7bf37-e781-4638-baeb-fe3b6208ed38]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:02 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e8ab52a2-49a6-4550-b427-a55faecdfe78" returned: 0 in 0.659s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-e8ab52a2-49a6-4550-b427-a55faecdfe78" released by "delete_volume" :: held 1.373s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:02 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:02 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['6859aba2-202a-44bc-abe1-febe5db780b3', '65e86777-e168-4317-bffc-bc78c87fb73d', 'e73ffe27-58af-421f-9b25-077e165b1f0c', 'ff1e3377-6113-4e88-9f38-1f996b3bc456'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:02 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebac709-cb56-4d48-9520-ff2055e45ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410839c8-a797-4baf-818a-6ea517dd5f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Volume volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 (6fa416c8-98aa-47a7-aab0-8ba780d62f95): created successfully Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410839c8-a797-4baf-818a-6ea517dd5f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (147528ff-e0b4-4013-aad3-dae4c87ed917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6e3c091f-1fd0-4e2e-af9e-cb8edc977da3 tempest-VolumesListAdminTestJSON-36570670 None] Created volume successfully. Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:02 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:02 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:03 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780" returned: 0 in 0.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:03 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780 Sep 29 12:43:03 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:03 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Deleted volume successfully. Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-739abbbb-7f17-45be-ab5a-0d12afff66e4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd9c9767-1e2f-404d-a23d-ef10bb146e7b tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-e8ab52a2-49a6-4550-b427-a55faecdfe78-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-739abbbb-7f17-45be-ab5a-0d12afff66e4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:03 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8a8edb9a-8297-4a98-8f6f-1776b240b780" returned: 0 in 0.640s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd78c08-a44c-441b-8aaa-380f6bad7177]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-8a8edb9a-8297-4a98-8f6f-1776b240b780" released by "delete_volume" :: held 1.419s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:03 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 Sep 29 12:43:03 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Created reservations ['7b7f1854-aa40-446e-8c56-9be3aae4ac49', 'cc4eee18-14d6-4acf-8504-01421bdd8d97', 'c36a9d50-381a-4e79-9320-59c05644b1ea', 'f77bf249-ad4c-4441-8e4e-6b2ce755495c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (9d28e807-a4d2-4200-90a8-391bce1f54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bbbe93-196c-4f4a-90ec-663fd8c3bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bbbe93-196c-4f4a-90ec-663fd8c3bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603886151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d9bf07-bedd-4a82-9630-59bfc664d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48df6b8-3c5a-4f0b-9398-a29fccf7c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48df6b8-3c5a-4f0b-9398-a29fccf7c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfddea2-3b4d-499c-ba68-030af1ea7ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfddea2-3b4d-499c-ba68-030af1ea7ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d9bf07-bedd-4a82-9630-59bfc664d656', 'volume_name': 'volume-c6d9bf07-bedd-4a82-9630-59bfc664d656', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4668536b-20a7-41ad-82a0-c4844e8d88db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4668536b-20a7-41ad-82a0-c4844e8d88db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6333bfb5-02d3-49c5-b252-0c4bba04f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Volume c6d9bf07-bedd-4a82-9630-59bfc664d656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d9bf07-bedd-4a82-9630-59bfc664d656', 'volume_size': 1} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603886151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d9bf07-bedd-4a82-9630-59bfc664d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe92cc7d1804d539554f40e16ff502e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='ee579329171045aba1a349db8bb37646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Creating volume c6d9bf07-bedd-4a82-9630-59bfc664d656 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:04 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:04 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 1073741824 Sep 29 12:43:04 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:04 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4" returned: 0 in 0.677s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:04 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:04 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:04 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4 Sep 29 12:43:04 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:04 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-739abbbb-7f17-45be-ab5a-0d12afff66e4" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-quobyte-739abbbb-7f17-45be-ab5a-0d12afff66e4" released by "delete_volume" :: held 1.303s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Created reservations ['0d5d6b87-9e0b-4f5c-8cb0-b1abedd4b739', '99eb13ef-fd40-4f99-98f9-e9bce990a414', '9e9ba167-1914-4978-9cca-1c4025e7e251', '6babd808-9740-4c37-a299-a9fc4d4a6275'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:05 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.844s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:05 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 1073741824" returned: 0 in 1.057s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d21c0d50-5676-486b-86d6-9e1c16e65954 tempest-VolumesGetTest-1203079796 None] Lock "cinder-8a8edb9a-8297-4a98-8f6f-1776b240b780-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:05 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:05 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:05 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 Sep 29 12:43:05 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (0b6736ea-b1f4-4220-95d2-da1ddfe6e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29eddac-caa5-4086-bc16-01aa6e6cfae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29eddac-caa5-4086-bc16-01aa6e6cfae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408124192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5272f46c-5c87-41e4-9e91-f0840e9f84cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:06Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42637d6-6f05-4751-95cc-732447aeaad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42637d6-6f05-4751-95cc-732447aeaad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:05 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1772b10b-1395-44ff-b69d-6983db949092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1772b10b-1395-44ff-b69d-6983db949092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'volume_name': 'volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb55e02-0163-4889-914b-98d00d6db4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb55e02-0163-4889-914b-98d00d6db4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d6cd4b-ceb4-4ed4-9cc9-a206da4a1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Volume 5272f46c-5c87-41e4-9e91-f0840e9f84cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'volume_size': 1} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Deleted volume successfully. Sep 29 12:43:05 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-099f9ea3-2b0f-4879-97d5-735e31bfe56c tempest-VolumesSnapshotTestJSON-1474533700 None] Lock "cinder-739abbbb-7f17-45be-ab5a-0d12afff66e4-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656" returned: 0 in 0.499s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408124192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5272f46c-5c87-41e4-9e91-f0840e9f84cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:06Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Creating volume 5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:06 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd 1073741824 Sep 29 12:43:06 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6333bfb5-02d3-49c5-b252-0c4bba04f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d9bf07-bedd-4a82-9630-59bfc664d656', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfd06e-4d4e-4a8f-9d41-68633c0192c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Volume volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 (c6d9bf07-bedd-4a82-9630-59bfc664d656): created successfully Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfd06e-4d4e-4a8f-9d41-68633c0192c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Flow 'volume_create_manager' (9d28e807-a4d2-4200-90a8-391bce1f54bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-28c8b122-f183-4bc4-96d9-35cafb3007b4 tempest-VolumesListAdminTestJSON-36570670 None] Created volume successfully. Sep 29 12:43:06 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd 1073741824" returned: 0 in 0.742s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:06 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:06 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:07 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d6cd4b-ceb4-4ed4-9cc9-a206da4a1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787857b-4852-4cf6-8056-f2540f55b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Volume volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd (5272f46c-5c87-41e4-9e91-f0840e9f84cd): created successfully Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787857b-4852-4cf6-8056-f2540f55b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (0b6736ea-b1f4-4220-95d2-da1ddfe6e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9f6eb76d-ccb9-4d44-a4d0-28e3f932cd21 tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Flow 'volume_create_manager' (388b7078-1db8-4bbd-8fa9-b0bfb3a0a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a62fb0c-1f6d-418a-9e89-df6896aa1f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a62fb0c-1f6d-418a-9e89-df6896aa1f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0066d7-dc33-46ae-8a1b-b23b4f104f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1321d2d61d4c4a4a945ba4d06fa30a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:08Z,use_quota=True,user_id='514ab689c81d466c984b3689ac5952bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95184bb-8afa-499f-b1d7-d24af30460e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95184bb-8afa-499f-b1d7-d24af30460e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f243fb8-e2ad-4652-acb5-b0586dd51dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f243fb8-e2ad-4652-acb5-b0586dd51dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0066d7-dc33-46ae-8a1b-b23b4f104f01', 'volume_name': 'volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efef965-a1c0-4972-afe5-0a8be390f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efef965-a1c0-4972-afe5-0a8be390f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e6cee-7ad3-4c2f-9aff-7fafebb3e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Volume bb0066d7-dc33-46ae-8a1b-b23b4f104f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01', 'volume_size': 1} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0066d7-dc33-46ae-8a1b-b23b4f104f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1321d2d61d4c4a4a945ba4d06fa30a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:08Z,use_quota=True,user_id='514ab689c81d466c984b3689ac5952bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Creating volume bb0066d7-dc33-46ae-8a1b-b23b4f104f01 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:08 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:08 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 1073741824 Sep 29 12:43:08 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (07dbff17-daec-42d6-80b3-8b16f78758a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1865e44-12fd-45f9-a502-358c8322d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1865e44-12fd-45f9-a502-358c8322d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-602772171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9b9248-b936-41ac-98d6-9adb7f1fdbfe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5272f46c-5c87-41e4-9e91-f0840e9f84cd,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:09Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c568ad-3d5a-44ea-ab74-d4f9877b7cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c568ad-3d5a-44ea-ab74-d4f9877b7cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf95e62e-278b-4602-a822-c8d5b0558fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf95e62e-278b-4602-a822-c8d5b0558fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5c9b9248-b936-41ac-98d6-9adb7f1fdbfe', 'volume_name': 'volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe', 'volume_size': 1, 'source_volid': '5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11699f32-006d-4d78-bbee-0b380759eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11699f32-006d-4d78-bbee-0b380759eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebba6264-c43a-480b-9198-4a9320eb5def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Volume 5c9b9248-b936-41ac-98d6-9adb7f1fdbfe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe', 'volume_size': 1, 'source_volid': '5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'source_volstatus': 'available'} Sep 29 12:43:09 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 1073741824" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:09 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 Sep 29 12:43:09 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:09 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" returned: 0 in 0.345s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.409s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:09 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Cloning volume 5272f46c-5c87-41e4-9e91-f0840e9f84cd to volume 5c9b9248-b936-41ac-98d6-9adb7f1fdbfe Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e6cee-7ad3-4c2f-9aff-7fafebb3e319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9156912-097a-4d8f-8290-846dd73a78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Creating offline snapshot cf9828af-1656-49e4-ac29-091bb6d01433 of volume 5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:43:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Volume volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 (bb0066d7-dc33-46ae-8a1b-b23b4f104f01): created successfully Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9156912-097a-4d8f-8290-846dd73a78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Flow 'volume_create_manager' (388b7078-1db8-4bbd-8fa9-b0bfb3a0a195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f466f-e44e-413b-bf6f-6a1953376e9b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-94b0b1d3-9865-41d9-87c7-9e5daec197b2 tempest-VolumesListAdminTestJSON-251346116 None] Created volume successfully. Sep 29 12:43:10 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:10 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:10 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.421s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:10 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 1G Sep 29 12:43:10 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Acquiring lock "cinder-bb0066d7-dc33-46ae-8a1b-b23b4f104f01-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "cinder-bb0066d7-dc33-46ae-8a1b-b23b4f104f01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Acquiring lock "cinder-quobyte-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "cinder-quobyte-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b401d5c-4594-425e-8118-a90f93b22916]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:10 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 1G" returned: 0 in 0.604s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-c6d9bf07-bedd-4a82-9630-59bfc664d656-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:11 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-c6d9bf07-bedd-4a82-9630-59bfc664d656-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:11 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-quobyte-c6d9bf07-bedd-4a82-9630-59bfc664d656" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-c6d9bf07-bedd-4a82-9630-59bfc664d656" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:11 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 Sep 29 12:43:11 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b24d112-e3b7-4d8d-bbab-3a452be2e7bc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:11 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 Sep 29 12:43:11 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.416s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 is being set with open permissions: ugo+rw Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:11 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:11 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" returned: 0 in 0.557s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:11 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01 Sep 29 12:43:11 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656" returned: 0 in 0.504s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:11 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.315s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:11 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656 Sep 29 12:43:11 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:11 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info Sep 29 12:43:11 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:11 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" returned: 0 in 0.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "cinder-quobyte-bb0066d7-dc33-46ae-8a1b-b23b4f104f01" released by "delete_volume" :: held 1.025s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Created reservations ['95997895-8926-4a62-9cb0-e4a89610957f', '6ac85b25-5b86-40c3-b018-9090790c82ab', 'c268efea-e2e2-43fb-9010-3c6609033d38', '786a0b2d-0788-4099-8b1f-157fe5622d26'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:12 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6d9bf07-bedd-4a82-9630-59bfc664d656" returned: 0 in 0.564s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-c6d9bf07-bedd-4a82-9630-59bfc664d656" released by "delete_volume" :: held 1.191s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:12 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:12 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:12 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info" returned: 0 in 0.652s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:12 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info is being set with open permissions: ugo+rw Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Created reservations ['b0c54c44-31be-4dee-ac8a-5ee8c3b4bc34', 'f2da57bf-491c-4f7b-9562-a6561f91cf18', 'be4e7184-b7d4-4ae2-ad2c-629301671c74', '464b5fe1-ea43-4793-ab4b-0108a7c2ced9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:12 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info Sep 29 12:43:12 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:12 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:12 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:12 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Deleted volume successfully. Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0592d68a-4045-4030-86ae-9cb2347342dc tempest-VolumesListAdminTestJSON-251346116 None] Lock "cinder-bb0066d7-dc33-46ae-8a1b-b23b4f104f01-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:12 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.info" returned: 0 in 0.340s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] snapshot: cf9828af-1656-49e4-ac29-091bb6d01433, volume: 5c9b9248-b936-41ac-98d6-9adb7f1fdbfe, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3dceed-4cc7-447c-9529-a09c909dfe0e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:12 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:12 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.374s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:12 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Deleted volume successfully. Sep 29 12:43:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7dea94e-b6a2-47e4-ac7c-75e5fc860c96 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-c6d9bf07-bedd-4a82-9630-59bfc664d656-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:13 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.484s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[08968c75-e2ed-40e1-8271-51d7767f569e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:13 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:13 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-6fa416c8-98aa-47a7-aab0-8ba780d62f95-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-6fa416c8-98aa-47a7-aab0-8ba780d62f95-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-quobyte-6fa416c8-98aa-47a7-aab0-8ba780d62f95" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-6fa416c8-98aa-47a7-aab0-8ba780d62f95" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab7db2-14b0-4512-b5bc-3257982833f5]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:14 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.663s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:14 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 Sep 29 12:43:14 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:14 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe Sep 29 12:43:14 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:14 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95" returned: 0 in 0.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:14 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95 Sep 29 12:43:14 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:14 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6fa416c8-98aa-47a7-aab0-8ba780d62f95" returned: 0 in 0.435s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-6fa416c8-98aa-47a7-aab0-8ba780d62f95" released by "delete_volume" :: held 1.124s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Created reservations ['24410f3c-7a86-4257-92e8-5d4e3f4689fb', '691a6546-f4d2-4167-b688-aa393999f831', 'df760226-d985-4729-8dcc-b7494f7a5d0f', 'ed9d396e-9574-449e-a5bf-55318fe89023'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:15 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:15 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:15 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.518s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Deleted volume successfully. Sep 29 12:43:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-631e8f68-0f0e-4050-b22a-4749b9a38281 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-6fa416c8-98aa-47a7-aab0-8ba780d62f95-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-43d4ce98-06ea-4660-8630-597e93b14d4d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-43d4ce98-06ea-4660-8630-597e93b14d4d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "cinder-quobyte-43d4ce98-06ea-4660-8630-597e93b14d4d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-43d4ce98-06ea-4660-8630-597e93b14d4d" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1e88a-72b9-44d8-a64e-77c0afbf88f4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:16 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d Sep 29 12:43:16 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:17 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d" returned: 0 in 1.299s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:18 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d Sep 29 12:43:18 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:18 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-43d4ce98-06ea-4660-8630-597e93b14d4d" returned: 0 in 0.803s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-quobyte-43d4ce98-06ea-4660-8630-597e93b14d4d" released by "delete_volume" :: held 2.243s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Created reservations ['dabedf4d-f86b-4f10-b823-aa42ab6f5d77', '32c4196e-d12a-42ec-a56b-a34fa847bbdb', '769e34a6-aea0-48ad-a9a1-0cfa7cde5abd', '1c5c232f-72b7-4f46-898d-e1483a366c1d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:19 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:19 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:19 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Deleted volume successfully. Sep 29 12:43:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-212eb733-a776-41e6-b9b0-14c3367f6990 tempest-VolumesListAdminTestJSON-36570670 None] Lock "cinder-43d4ce98-06ea-4660-8630-597e93b14d4d-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Flow 'volume_create_manager' (a5f96949-522c-46a7-b5b7-6389ad71bfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d083d4b-8058-4b97-be8d-bdd0210ca1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d083d4b-8058-4b97-be8d-bdd0210ca1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1634044891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb16e86-2892-46d5-a81b-28f46e769350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a777247b174a2582aa0eadf7124a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:22Z,use_quota=True,user_id='94432593a76b4832b04d9fc1fc41d6f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95236fc6-0584-4efa-b68c-2c86a8f22255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95236fc6-0584-4efa-b68c-2c86a8f22255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338d4b9-bab6-4543-9730-45bc1449d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338d4b9-bab6-4543-9730-45bc1449d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb16e86-2892-46d5-a81b-28f46e769350', 'volume_name': 'volume-abb16e86-2892-46d5-a81b-28f46e769350', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c929f957-d0dd-4954-96a4-c7a409d5f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c929f957-d0dd-4954-96a4-c7a409d5f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f4f6e3-4673-4b42-9d6b-15c80a58cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Volume abb16e86-2892-46d5-a81b-28f46e769350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb16e86-2892-46d5-a81b-28f46e769350', 'volume_size': 2} Sep 29 12:43:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:23 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" returned: 0 in 9.399s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd, size 1024.00 MB, duration 9.40 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:43:23 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Converted 1024.00 MB image at 108.93 MB/s Sep 29 12:43:23 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe is being set with open permissions: ugo+rw Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:23 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe Sep 29 12:43:23 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:23 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" returned: 0 in 0.273s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" released by "_copy_volume_from_snapshot" :: held 10.931s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-cf9828af-1656-49e4-ac29-091bb6d01433" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-cf9828af-1656-49e4-ac29-091bb6d01433" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Deleting offline snapshot cf9828af-1656-49e4-ac29-091bb6d01433 of volume 5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] snapshot_file for this snap is: volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f99f97-f804-4fe8-9b20-08e051fdd5a9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:23 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:23 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:24 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.467s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623dee8-1a08-413a-a2e6-a8d153fba74e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:24 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:24 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:24 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.616s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:24 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:24 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:25 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:25 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433 Sep 29 12:43:25 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:25 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd.cf9828af-1656-49e4-ac29-091bb6d01433" returned: 0 in 0.289s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-cf9828af-1656-49e4-ac29-091bb6d01433" released by "_delete_snapshot" :: held 1.913s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.908s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.426s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1634044891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb16e86-2892-46d5-a81b-28f46e769350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a777247b174a2582aa0eadf7124a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:22Z,use_quota=True,user_id='94432593a76b4832b04d9fc1fc41d6f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Creating volume abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 2147483648 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:25 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 2147483648 Sep 29 12:43:25 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebba6264-c43a-480b-9198-4a9320eb5def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe', 'volume_size': 1, 'source_volid': '5272f46c-5c87-41e4-9e91-f0840e9f84cd', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c2b081-c84a-4567-b9eb-6e6b00c352d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Volume volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe (5c9b9248-b936-41ac-98d6-9adb7f1fdbfe): created successfully Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c2b081-c84a-4567-b9eb-6e6b00c352d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (07dbff17-daec-42d6-80b3-8b16f78758a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3a419b77-eeee-4e3c-a734-641d7fd89beb tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:43:26 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 2147483648" returned: 0 in 0.745s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:26 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 Sep 29 12:43:26 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:26 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (f4c45819-58d6-4e36-8085-f990814db9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519b57ee-eaef-457e-b507-d1a5b8b53b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350" returned: 0 in 0.453s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519b57ee-eaef-457e-b507-d1a5b8b53b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-908226887',display_name='tempest-VolumesGetTest-Volume-71224545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5b59e4-f7aa-4f89-aea2-4ce901e73c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:27Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d879bc2-8dad-44a2-81d2-834c6fdab71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d879bc2-8dad-44a2-81d2-834c6fdab71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b714316-4966-4ce4-86df-1c978726d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b714316-4966-4ce4-86df-1c978726d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5b59e4-f7aa-4f89-aea2-4ce901e73c85', 'volume_name': 'volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da8469a-e1bf-401c-afb1-8304dfc95448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da8469a-e1bf-401c-afb1-8304dfc95448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9260ae3-c457-4b4a-9a90-2c7b40af9003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Volume fb5b59e4-f7aa-4f89-aea2-4ce901e73c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85', 'volume_size': 1} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-908226887',display_name='tempest-VolumesGetTest-Volume-71224545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5b59e4-f7aa-4f89-aea2-4ce901e73c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:27Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Creating volume fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:27 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f4f6e3-4673-4b42-9d6b-15c80a58cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb16e86-2892-46d5-a81b-28f46e769350', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecd236d-153b-4554-ac03-2e8d5262c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:27 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 1073741824 Sep 29 12:43:27 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Volume volume-abb16e86-2892-46d5-a81b-28f46e769350 (abb16e86-2892-46d5-a81b-28f46e769350): created successfully Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecd236d-153b-4554-ac03-2e8d5262c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Flow 'volume_create_manager' (a5f96949-522c-46a7-b5b7-6389ad71bfc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-612348a0-f75c-4e93-9aee-420cecdc58ed tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Created volume successfully. Sep 29 12:43:27 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 1073741824" returned: 0 in 0.589s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:27 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 Sep 29 12:43:27 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:28 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.188s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9260ae3-c457-4b4a-9a90-2c7b40af9003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c253904c-e756-4fe8-b263-38b856510b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Creating offline snapshot b9e9b8cb-c7fa-461d-a8e9-cefa395536dc of volume abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:43:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Volume volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 (fb5b59e4-f7aa-4f89-aea2-4ce901e73c85): created successfully Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c253904c-e756-4fe8-b263-38b856510b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (f4c45819-58d6-4e36-8085-f990814db9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[51363e1d-daca-4720-ba34-2880db8c1aad]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1ff6de63-b96d-45e0-bd08-fdc1c4ef643f tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:43:28 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 Sep 29 12:43:28 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:28 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350" returned: 0 in 0.424s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:28 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc 2G Sep 29 12:43:28 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:29 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc 2G" returned: 0 in 0.567s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb16e86-2892-46d5-a81b-28f46e769350 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:29 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb16e86-2892-46d5-a81b-28f46e769350 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc Sep 29 12:43:29 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "cinder-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93d9b8-eb42-4ef7-a8a4-e88f7c15f6eb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:29 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 Sep 29 12:43:29 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:29 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb16e86-2892-46d5-a81b-28f46e769350 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" returned: 0 in 0.414s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc is being set with open permissions: ugo+rw Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:29 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc Sep 29 12:43:29 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:29 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" returned: 0 in 0.483s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:29 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85 Sep 29 12:43:29 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:29 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:29 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info Sep 29 12:43:29 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:30 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" returned: 0 in 0.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:30 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:30 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85" released by "delete_volume" :: held 0.965s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Created reservations ['4b0bc700-d257-4cc3-8237-d335304f763e', '645331a7-cc33-4412-a4bc-c9645e86b72e', '4623b6db-50d8-4d2a-9e4d-5e89d9616f13', 'a8445674-99be-47a8-a2f4-af30dbd55ec7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:30 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info" returned: 0 in 0.484s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info is being set with open permissions: ugo+rw Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:30 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info Sep 29 12:43:30 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:30 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:30 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:30 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.421s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-22675e4b-c1ae-4396-802b-5ef0222791d0 req-2b5f533e-849e-40ab-b18e-416ac8ef36db tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:30 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.info" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:30 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-22675e4b-c1ae-4396-802b-5ef0222791d0 req-2b5f533e-849e-40ab-b18e-416ac8ef36db tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.079s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.342s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-22675e4b-c1ae-4396-802b-5ef0222791d0 req-2b5f533e-849e-40ab-b18e-416ac8ef36db tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0f6db70-bc57-45ba-9f39-1502fe3d6bd0 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Create snapshot completed successfully Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ec06d6b-5843-48d7-bc68-7e787ab1ee61 tempest-VolumesGetTest-1203079796 None] Lock "cinder-fb5b59e4-f7aa-4f89-aea2-4ce901e73c85-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-22675e4b-c1ae-4396-802b-5ef0222791d0 req-2b5f533e-849e-40ab-b18e-416ac8ef36db tempest-TestInstancesWithCinderVolumes-188249689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-0db41199-7941-4067-a211-3d1165b3d929', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8eaf4e4-56be-4357-8d20-8052e1742b94', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:43:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-22675e4b-c1ae-4396-802b-5ef0222791d0 req-2b5f533e-849e-40ab-b18e-416ac8ef36db tempest-TestInstancesWithCinderVolumes-188249689 None] attachment_update completed successfully. Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "cinder-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "cinder-quobyte-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Deleting offline snapshot b9e9b8cb-c7fa-461d-a8e9-cefa395536dc of volume abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] snapshot_file for this snap is: volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c272a147-ac50-4e43-ab1f-c8b3f9daf59e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:31 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc Sep 29 12:43:31 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "cinder-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:31 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" returned: 0 in 0.532s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abb16e86-2892-46d5-a81b-28f46e769350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aedbc1a-849b-4742-883d-b297a4c86f45]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d97c1-eb83-4543-8090-f55cec70281a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:31 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe Sep 29 12:43:31 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 Sep 29 12:43:32 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Flow 'volume_create_manager' (92cf79ff-843a-46c9-ae39-c3fcc03a4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ae8fbe-2da9-4c7d-aa58-57b1dd4a75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ae8fbe-2da9-4c7d-aa58-57b1dd4a75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-843581168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524c6cd-69bf-4a30-939e-0c19faca55f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d969ad41a2ba49bb869e283a8de8f750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:32Z,use_quota=True,user_id='2caf743fe23140fbbe55ff977907dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e96409-3a19-4e36-aeed-0a7741f3bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e96409-3a19-4e36-aeed-0a7741f3bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e830f9eb-b914-4729-ba9d-eb4c35adf12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e830f9eb-b914-4729-ba9d-eb4c35adf12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3524c6cd-69bf-4a30-939e-0c19faca55f6', 'volume_name': 'volume-3524c6cd-69bf-4a30-939e-0c19faca55f6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532a545-ded9-4d98-b9da-d2736a465326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532a545-ded9-4d98-b9da-d2736a465326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc681766-62ff-4885-b9da-801254921ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Volume 3524c6cd-69bf-4a30-939e-0c19faca55f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3524c6cd-69bf-4a30-939e-0c19faca55f6', 'volume_size': 1} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-843581168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524c6cd-69bf-4a30-939e-0c19faca55f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d969ad41a2ba49bb869e283a8de8f750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:32Z,use_quota=True,user_id='2caf743fe23140fbbe55ff977907dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Creating volume 3524c6cd-69bf-4a30-939e-0c19faca55f6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:32 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:32 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" returned: 0 in 0.576s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:32 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 1073741824 Sep 29 12:43:32 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe Sep 29 12:43:32 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350" returned: 0 in 0.609s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:32 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc Sep 29 12:43:32 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" returned: 0 in 0.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe" released by "delete_volume" :: held 0.955s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Created reservations ['dc231554-084d-4625-95be-1104fd1c988b', '49fffa61-ca65-44cf-ae09-c074d21349cd', 'c79e13ac-0f78-42b3-8e4e-eb76ee0714c0', '3c1f5383-27a0-4dda-9b8f-bf0c7cea571e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:32 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" returned: 0 in 0.419s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:32 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc Sep 29 12:43:32 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:32 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:32 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 1073741824" returned: 0 in 0.611s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:33 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 Sep 29 12:43:33 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:33 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350.b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" returned: 0 in 0.369s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:33 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.399s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc" released by "_delete_snapshot" :: held 2.099s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" released by "delete_snapshot" :: held 2.127s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-33ad375c-07b3-4e9d-83fd-99f72f1e233c tempest-VolumesGetTest-1203079796 None] Lock "cinder-5c9b9248-b936-41ac-98d6-9adb7f1fdbfe-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:33 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6" returned: 0 in 0.373s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Created reservations ['bd1d444a-e712-4edc-b442-e5920b2f97ca', '84f1bcec-3a7d-4c11-94ab-45a377632925', '2a4f4b26-f194-403b-8654-975f26f40ba5', '730c09c5-27aa-4527-a13d-011e82c3729c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc681766-62ff-4885-b9da-801254921ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3524c6cd-69bf-4a30-939e-0c19faca55f6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aee1b9b-e37e-4588-bd83-9284775a145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Volume volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 (3524c6cd-69bf-4a30-939e-0c19faca55f6): created successfully Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aee1b9b-e37e-4588-bd83-9284775a145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Flow 'volume_create_manager' (92cf79ff-843a-46c9-ae39-c3fcc03a4011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-91cedb62-6722-442a-88d9-c9b31c935361 tempest-VolumesNegativeTest-714480844 None] Created volume successfully. Sep 29 12:43:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Delete snapshot completed successfully. Sep 29 12:43:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a2e32429-8450-4f2d-a798-3a7231a786c9 tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-b9e9b8cb-c7fa-461d-a8e9-cefa395536dc-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-5272f46c-5c87-41e4-9e91-f0840e9f84cd-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "cinder-5272f46c-5c87-41e4-9e91-f0840e9f84cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-5272f46c-5c87-41e4-9e91-f0840e9f84cd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5272f46c-5c87-41e4-9e91-f0840e9f84cd" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[420a21ac-0411-4747-a518-5f55ab3dc446]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-51171d29-c169-4c7c-810d-da459e7a62ec req-c1f5506f-56ed-4ba7-ad36-208b1ec892a8 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-51171d29-c169-4c7c-810d-da459e7a62ec req-c1f5506f-56ed-4ba7-ad36-208b1ec892a8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-51171d29-c169-4c7c-810d-da459e7a62ec req-c1f5506f-56ed-4ba7-ad36-208b1ec892a8 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-51171d29-c169-4c7c-810d-da459e7a62ec req-c1f5506f-56ed-4ba7-ad36-208b1ec892a8 tempest-TestInstancesWithCinderVolumes-188249689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f330d819-3710-4b3c-af8d-a6cef0795263', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:43:34 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:34 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-51171d29-c169-4c7c-810d-da459e7a62ec req-c1f5506f-56ed-4ba7-ad36-208b1ec892a8 tempest-TestInstancesWithCinderVolumes-188249689 None] attachment_update completed successfully. Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "cinder-abb16e86-2892-46d5-a81b-28f46e769350-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-abb16e86-2892-46d5-a81b-28f46e769350-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f83e6-90c5-4d6e-a2b4-65493679982f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:34 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.522s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:34 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd Sep 29 12:43:34 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:34 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 Sep 29 12:43:34 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:35 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5272f46c-5c87-41e4-9e91-f0840e9f84cd" returned: 0 in 0.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-5272f46c-5c87-41e4-9e91-f0840e9f84cd" released by "delete_volume" :: held 0.984s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Created reservations ['42d90290-7932-4ef8-b372-4998ba645f7e', 'eb8dad1c-9702-402a-bb4e-c2dbe6c77e03', '653e64ba-b387-46f9-9419-30bab2080fd7', 'e7fab396-ca52-4a10-98e9-3841600c96ab'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:35 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350" returned: 0 in 0.699s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:35 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350 Sep 29 12:43:35 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:35 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:35 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:35 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-abb16e86-2892-46d5-a81b-28f46e769350" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:35 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-quobyte-abb16e86-2892-46d5-a81b-28f46e769350" released by "delete_volume" :: held 1.130s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fdcb0c8d-b930-4f77-bb26-98c2405e9be3 tempest-VolumesGetTest-1203079796 None] Lock "cinder-5272f46c-5c87-41e4-9e91-f0840e9f84cd-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Created reservations ['b076051c-7cc2-46ff-b09a-6cd18053c1e3', '49f1e45d-b090-440d-8e6f-866c8a328683', '2585650d-06ad-4694-8ac1-edffefccd914', 'ce233af3-42aa-4ce7-bd16-8557ffe26db1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:35 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:35 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:36 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Deleted volume successfully. Sep 29 12:43:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e456530d-e5da-4bfe-a08d-17ee560956fb tempest-VolumesSnapshotNegativeTestJSON-650192003 None] Lock "cinder-abb16e86-2892-46d5-a81b-28f46e769350-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (2c1bbc2a-da98-45e8-9578-5817e4ef5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49249d19-c751-460b-8b09-7c1a798be4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49249d19-c751-460b-8b09-7c1a798be4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-233363171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbecb91-9171-4f05-bd16-d471ba549687,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:37Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146220af-d416-441a-935c-8808a5900fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146220af-d416-441a-935c-8808a5900fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e6af19-58aa-48ef-a0ca-37050c4f3a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:37 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e6af19-58aa-48ef-a0ca-37050c4f3a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ccbecb91-9171-4f05-bd16-d471ba549687', 'volume_name': 'volume-ccbecb91-9171-4f05-bd16-d471ba549687', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b3106f-e543-44ad-9ce9-1e1e624fb1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b3106f-e543-44ad-9ce9-1e1e624fb1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b4803a-054f-46f3-a169-ad1519702d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Volume ccbecb91-9171-4f05-bd16-d471ba549687: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ccbecb91-9171-4f05-bd16-d471ba549687', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Trying to clone ccbecb91-9171-4f05-bd16-d471ba549687 from image 94feb733-57cd-4052-a12a-6ab2ace34da5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:43:38 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d3e9f-61c5-4abb-ab09-8d6ec01eecc0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:38 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD Sep 29 12:43:38 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:39 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD" returned: 0 in 0.496s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:39 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 is fetched for user a25b0a146a52435184ac3f5c738faa86. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:43:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d06782-bc87-4b5a-98c1-93c23a51895a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:39 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD Sep 29 12:43:39 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:40 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-233363171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbecb91-9171-4f05-bd16-d471ba549687,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:37Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Creating volume ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:40 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:40 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1073741824 Sep 29 12:43:40 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:40 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1073741824" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:41 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 Sep 29 12:43:41 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:41 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Attempting download of 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume ccbecb91-9171-4f05-bd16-d471ba549687. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[52253f7b-4aa3-4f3c-bef2-0cbe12638e70]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:41 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka Sep 29 12:43:41 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:42 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka" returned: 0 in 0.773s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-64bad885-40c2-4f69-8d93-b43c4643e083 req-8e4ef429-c7f9-40ac-99ee-9e566f010bbe tempest-TestInstancesWithCinderVolumes-188249689 None] Terminate volume connection completed successfully. Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-64bad885-40c2-4f69-8d93-b43c4643e083 req-8e4ef429-c7f9-40ac-99ee-9e566f010bbe tempest-TestInstancesWithCinderVolumes-188249689 None] Deleting attachment e8eaf4e4-56be-4357-8d20-8052e1742b94. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:43:42 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka Sep 29 12:43:42 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:42 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka" returned: 1 in 0.565s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_v0r7myka' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[72030936-2ec5-45c1-b106-20958268a963]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:43 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD Sep 29 12:43:43 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-0db41199-7941-4067-a211-3d1165b3d929-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:43 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD" returned: 0 in 0.636s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] 94feb733-57cd-4052-a12a-6ab2ace34da5 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-0db41199-7941-4067-a211-3d1165b3d929-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:43 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 Sep 29 12:43:43 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-quobyte-0db41199-7941-4067-a211-3d1165b3d929" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-0db41199-7941-4067-a211-3d1165b3d929" acquired by "delete_volume" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf7d60f-ad30-48c8-bfec-0fee0b1020cb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:44 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 Sep 29 12:43:44 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:44 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929" returned: 0 in 0.660s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:44 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929 Sep 29 12:43:44 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:44 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0db41199-7941-4067-a211-3d1165b3d929" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-0db41199-7941-4067-a211-3d1165b3d929" released by "delete_volume" :: held 1.139s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:44 devstack cinder-volume[86763]: WARNING cinder.quota [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-438378909-1656681922 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-438378909-1656681922, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:43:44 devstack cinder-volume[86763]: WARNING cinder.quota [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-438378909-1656681922 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-438378909-1656681922, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Created reservations ['0fa8374f-ae05-482d-81f7-ed9db8c486ae', 'c2086233-3d7a-4674-b9be-3839c4cf073c', '77b1ff63-5911-441a-8aa9-709fa04c2a8e', 'd227007d-f2b1-4acf-96bf-28525b18559a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:45 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:45 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:46 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.774s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Deleted volume successfully. Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed63288e-ea4b-42a8-af46-090c3107d8b7 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-0db41199-7941-4067-a211-3d1165b3d929-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:46 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687" returned: 0 in 3.361s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_q8uldvh7devstack@QuobyteHD, size 112.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:43:46 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Converted 112.00 MB image at 33.29 MB/s Sep 29 12:43:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:47 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1G Sep 29 12:43:47 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:47 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 1G" returned: 0 in 0.582s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Downloaded image 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume ccbecb91-9171-4f05-bd16-d471ba549687 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 for user a25b0a146a52435184ac3f5c738faa86 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Marking volume ccbecb91-9171-4f05-bd16-d471ba549687 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Copying metadata from image 94feb733-57cd-4052-a12a-6ab2ace34da5 to ccbecb91-9171-4f05-bd16-d471ba549687. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Creating volume glance metadata for volume ccbecb91-9171-4f05-bd16-d471ba549687 backed by image 94feb733-57cd-4052-a12a-6ab2ace34da5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b4803a-054f-46f3-a169-ad1519702d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbecb91-9171-4f05-bd16-d471ba549687', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd01169-5091-4166-a752-c6e49b98c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:47 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Volume volume-ccbecb91-9171-4f05-bd16-d471ba549687 (ccbecb91-9171-4f05-bd16-d471ba549687): created successfully Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd01169-5091-4166-a752-c6e49b98c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (2c1bbc2a-da98-45e8-9578-5817e4ef5940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-395c43f6-9f75-4f0f-8465-f440934adb00 tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (e34ca6a5-9295-4a0b-abcf-63156fced041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afb8ef5-5223-4310-88df-3baa8bd0be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afb8ef5-5223-4310-88df-3baa8bd0be06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1880413448',display_name='tempest-VolumesGetTest-Volume-439683503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503ebadd-a5ce-4019-b463-37a825092b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:50Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e7e51-d175-4c40-9e0c-088a13c01e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e7e51-d175-4c40-9e0c-088a13c01e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c27a42-66c2-4394-9d4b-ede28155dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c27a42-66c2-4394-9d4b-ede28155dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503ebadd-a5ce-4019-b463-37a825092b70', 'volume_name': 'volume-503ebadd-a5ce-4019-b463-37a825092b70', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7938ab35-b3f8-4d5b-bd6d-5d3f22a9f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7938ab35-b3f8-4d5b-bd6d-5d3f22a9f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7882ff04-f6c9-4300-8319-0bb171fd107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Volume 503ebadd-a5ce-4019-b463-37a825092b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503ebadd-a5ce-4019-b463-37a825092b70', 'volume_size': 1} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1880413448',display_name='tempest-VolumesGetTest-Volume-439683503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503ebadd-a5ce-4019-b463-37a825092b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f4806a927b4c8591bfcf75df136361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:50Z,use_quota=True,user_id='a25b0a146a52435184ac3f5c738faa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Creating volume 503ebadd-a5ce-4019-b463-37a825092b70 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:43:49 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-94043cb0-b5eb-46a1-bf41-13d44ba22d84 req-6be33f26-48b9-4546-8ec7-7a36f0eb0b6e tempest-TestInstancesWithCinderVolumes-188249689 None] Terminate volume connection completed successfully. Sep 29 12:43:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-94043cb0-b5eb-46a1-bf41-13d44ba22d84 req-6be33f26-48b9-4546-8ec7-7a36f0eb0b6e tempest-TestInstancesWithCinderVolumes-188249689 None] Deleting attachment f330d819-3710-4b3c-af8d-a6cef0795263. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:43:49 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 1073741824 Sep 29 12:43:49 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-quobyte-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:50 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 1073741824" returned: 0 in 0.666s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[534383ff-f1f9-406c-a2d7-c9642ba5b548]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:50 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 Sep 29 12:43:50 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:50 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a Sep 29 12:43:50 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:51 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70" returned: 0 in 0.526s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:51 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7882ff04-f6c9-4300-8319-0bb171fd107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503ebadd-a5ce-4019-b463-37a825092b70', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11e512a-8c7b-40fa-bcb9-81efae2c0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" returned: 0 in 0.659s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:51 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a Sep 29 12:43:51 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Volume volume-503ebadd-a5ce-4019-b463-37a825092b70 (503ebadd-a5ce-4019-b463-37a825092b70): created successfully Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11e512a-8c7b-40fa-bcb9-81efae2c0d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Flow 'volume_create_manager' (e34ca6a5-9295-4a0b-abcf-63156fced041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:43:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-071f4593-6685-4039-a262-c4f245daa8bd tempest-VolumesGetTest-1203079796 None] Created volume successfully. Sep 29 12:43:51 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a" released by "delete_volume" :: held 1.178s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:51 devstack cinder-volume[86763]: WARNING cinder.quota [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72083220-1214809210 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72083220-1214809210, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:43:51 devstack cinder-volume[86763]: WARNING cinder.quota [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72083220-1214809210 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72083220-1214809210, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Created reservations ['1d975400-82b8-4691-8b0d-7592465ef1bf', 'd62bbeaf-6aee-4492-8ead-57f873895625', 'b538eb0b-6c9e-4d0d-974c-3a6a1c8c81fb', '46515dcd-84a1-4f91-9edd-9fe8e1a1ad06'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:51 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:51 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-503ebadd-a5ce-4019-b463-37a825092b70-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "cinder-503ebadd-a5ce-4019-b463-37a825092b70-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:52 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Deleted volume successfully. Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd3edfd-1882-4c72-b19a-066faf750473 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-a514c1f5-e2ae-4e6b-87b6-ed6949eaf54a-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-503ebadd-a5ce-4019-b463-37a825092b70" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-503ebadd-a5ce-4019-b463-37a825092b70" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ef2b7-5f9e-4b6b-bcf9-b40b07445838]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:52 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 Sep 29 12:43:52 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:52 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70" returned: 0 in 0.451s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:52 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70 Sep 29 12:43:52 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:53 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-503ebadd-a5ce-4019-b463-37a825092b70" returned: 0 in 0.419s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-503ebadd-a5ce-4019-b463-37a825092b70" released by "delete_volume" :: held 0.930s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Created reservations ['8e1250f7-9ca3-4176-8b88-53848e091cf5', 'a78e638c-6aa8-4a5a-b6d9-e684ffb51f94', 'f74f3ed4-54db-4c46-a6dd-21c778115970', 'bcb126d8-0344-4727-9be0-236dbc0f981e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:53 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:53 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:53 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-23899258-fe83-4faa-8b30-df2a19a6fc6e tempest-VolumesGetTest-1203079796 None] Lock "cinder-503ebadd-a5ce-4019-b463-37a825092b70-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-ccbecb91-9171-4f05-bd16-d471ba549687-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "cinder-ccbecb91-9171-4f05-bd16-d471ba549687-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Acquiring lock "cinder-quobyte-ccbecb91-9171-4f05-bd16-d471ba549687" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-ccbecb91-9171-4f05-bd16-d471ba549687" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ce7e9-01fb-4ca0-9ffd-ab6bd8b1126d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:54 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 Sep 29 12:43:54 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:55 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687" returned: 0 in 0.550s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:55 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687 Sep 29 12:43:55 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:55 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ccbecb91-9171-4f05-bd16-d471ba549687" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "cinder-quobyte-ccbecb91-9171-4f05-bd16-d471ba549687" released by "delete_volume" :: held 1.046s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Created reservations ['b8d61e37-1c8a-4ce0-a0da-00a63766a65c', 'd881db15-ce90-44ef-a137-fca68d0a1454', '0ac4b98e-9b5f-45fb-90ea-e980d9dcf8ad', '623c9587-a9b0-4a31-b73b-c3ba11ee0910'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:43:56 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:43:56 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:43:56 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.411s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:43:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Deleted volume successfully. Sep 29 12:43:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4a4c7854-b2b9-40ed-8a84-2a5426ea975e tempest-VolumesGetTest-1203079796 None] Lock "cinder-ccbecb91-9171-4f05-bd16-d471ba549687-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:43:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-21dca83b-0b01-44c8-8f9b-44647e699d87 req-43870378-9181-4be7-aaa8-ee1fc6770413 tempest-TestInstancesWithCinderVolumes-188249689 None] Terminate volume connection completed successfully. Sep 29 12:43:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-21dca83b-0b01-44c8-8f9b-44647e699d87 req-43870378-9181-4be7-aaa8-ee1fc6770413 tempest-TestInstancesWithCinderVolumes-188249689 None] Deleting attachment 447fe717-b9d2-4190-9c92-5103d3adcfdd. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "cinder-quobyte-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a20167-95c0-4dab-ab34-cc9688d3899e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:43:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:00 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 Sep 29 12:44:00 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:00 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" returned: 0 in 0.553s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:00 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30 Sep 29 12:44:00 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:00 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" returned: 0 in 0.295s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-quobyte-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30" released by "delete_volume" :: held 0.914s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:44:00 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-115881008-1866243453 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-115881008-1866243453, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:44:00 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-115881008-1866243453 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-115881008-1866243453, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:44:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Created reservations ['af5cc56c-999c-48c8-92ac-621493594a2c', 'b39b7c89-9a87-48d8-bd7e-dff3064fd9b4', '1d9a3fb6-eecb-4a75-bd8f-129242e03c65', '2be94e7b-9c65-4295-bd07-33a6f6513f8e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:01 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:44:01 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:01 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.356s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:44:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Deleted volume successfully. Sep 29 12:44:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c60f4e22-0d92-494f-aae3-fa62c8f61f35 tempest-TestInstancesWithCinderVolumes-188249689 None] Lock "cinder-a3fe1e0b-2ec7-47c4-be08-8e1df946ae30-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Acquiring lock "cinder-3524c6cd-69bf-4a30-939e-0c19faca55f6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "cinder-3524c6cd-69bf-4a30-939e-0c19faca55f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=125,cinder:INSERT=42,cinder:UPDATE=159,cinder:DELETE=16 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=142,cinder:INSERT=52,cinder:DELETE=12,cinder:UPDATE=181 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Acquiring lock "cinder-quobyte-3524c6cd-69bf-4a30-939e-0c19faca55f6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:44:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "cinder-quobyte-3524c6cd-69bf-4a30-939e-0c19faca55f6" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[05783286-09de-4790-9b0d-6e9e2a5b5c3a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:03 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 Sep 29 12:44:03 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:03 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6" returned: 0 in 0.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:03 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6 Sep 29 12:44:03 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:03 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3524c6cd-69bf-4a30-939e-0c19faca55f6" returned: 0 in 0.324s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "cinder-quobyte-3524c6cd-69bf-4a30-939e-0c19faca55f6" released by "delete_volume" :: held 0.822s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Created reservations ['29f9f16d-e7be-4675-a906-b12461c4b21b', 'aea66239-0a74-40f6-8c7b-da51842f613d', 'd6f8704f-ff07-4d08-b777-aacf6aa28ecf', '45a54e0b-3757-46a6-b0c8-85d43226d0c1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:44:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:03 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:44:03 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:04 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:04 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:44:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Deleted volume successfully. Sep 29 12:44:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50f9ad3-8af2-4910-9584-aff30f60a977 tempest-VolumesNegativeTest-714480844 None] Lock "cinder-3524c6cd-69bf-4a30-939e-0c19faca55f6-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:44:13 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:14 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:44:30 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:44:30 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:44:30 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:44:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Flow 'volume_create_manager' (bdc88798-f557-4c8e-889a-3e9bdc217b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4758375-d2db-4667-97f9-1da800960af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4758375-d2db-4667-97f9-1da800960af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-661501318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069b818d-5a9a-46ba-b82e-c9e9561a0da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4f40c717574429a68fef91a0f968b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:07Z,use_quota=True,user_id='10deb974b6f64157bfe00212c1a3aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9937ffbd-d8b0-40f2-b61c-99321a8b8cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9937ffbd-d8b0-40f2-b61c-99321a8b8cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a966894-7ce3-48b3-b9c3-ce3fb62a5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a966894-7ce3-48b3-b9c3-ce3fb62a5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069b818d-5a9a-46ba-b82e-c9e9561a0da1', 'volume_name': 'volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d262489-00f3-4c5d-b961-0c8945df8706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d262489-00f3-4c5d-b961-0c8945df8706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c66701-e5a5-475f-915f-9cd62a4a1653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume 069b818d-5a9a-46ba-b82e-c9e9561a0da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1', 'volume_size': 1} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-661501318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069b818d-5a9a-46ba-b82e-c9e9561a0da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4f40c717574429a68fef91a0f968b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:07Z,use_quota=True,user_id='10deb974b6f64157bfe00212c1a3aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Creating volume 069b818d-5a9a-46ba-b82e-c9e9561a0da1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:45:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:07 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 1073741824 Sep 29 12:45:07 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Flow 'volume_create_manager' (6be10919-6ffd-4991-a408-5ad62edb0425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcb92bf-0c6f-43d9-a082-ab8351115635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcb92bf-0c6f-43d9-a082-ab8351115635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1536934342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0d13f0-9a35-430c-825b-a48f3bcde8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d50c7e3c444bdb8c08507f29fcb165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:08Z,use_quota=True,user_id='2804bbac7c7745e9815e9a101618f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67ec3f2-1d5d-4748-945c-31cd666f4d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67ec3f2-1d5d-4748-945c-31cd666f4d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011a6cc9-a71b-441a-8c17-2a9535c1240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:45:08 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 1073741824" returned: 0 in 0.931s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:08 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 Sep 29 12:45:08 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Flow 'volume_create_manager' (ef7bfeba-d2c1-4c3d-88cd-9746235ce530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86143534-2a1e-45ba-bfe9-c9a3f7f8c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86143534-2a1e-45ba-bfe9-c9a3f7f8c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1233122133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210c503f-50aa-4166-be5c-f306c7d76df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4f40c717574429a68fef91a0f968b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:09Z,use_quota=True,user_id='10deb974b6f64157bfe00212c1a3aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba2a61-b8ef-4851-8f6d-90716cee8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba2a61-b8ef-4851-8f6d-90716cee8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43a3d1d-c6c5-42af-af49-d62322801b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43a3d1d-c6c5-42af-af49-d62322801b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210c503f-50aa-4166-be5c-f306c7d76df7', 'volume_name': 'volume-210c503f-50aa-4166-be5c-f306c7d76df7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0f031-f92d-4fae-a80d-fde109869226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0f031-f92d-4fae-a80d-fde109869226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0778cc3c-925c-4da7-9b58-a7284f48bc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume 210c503f-50aa-4166-be5c-f306c7d76df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210c503f-50aa-4166-be5c-f306c7d76df7', 'volume_size': 1} Sep 29 12:45:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011a6cc9-a71b-441a-8c17-2a9535c1240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'volume_name': 'volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db98c93-7a43-405b-91f8-dddc37728c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db98c93-7a43-405b-91f8-dddc37728c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64067842-4759-44ed-aa30-c665078865d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Trying to clone 3a0d13f0-9a35-430c-825b-a48f3bcde8d7 from image 94feb733-57cd-4052-a12a-6ab2ace34da5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:45:09 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1" returned: 0 in 0.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1233122133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210c503f-50aa-4166-be5c-f306c7d76df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4f40c717574429a68fef91a0f968b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:09Z,use_quota=True,user_id='10deb974b6f64157bfe00212c1a3aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Creating volume 210c503f-50aa-4166-be5c-f306c7d76df7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:45:09 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c66701-e5a5-475f-915f-9cd62a4a1653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e43eff-2cf2-4f00-985d-aa3719b9c50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:09 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 1073741824 Sep 29 12:45:09 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 (069b818d-5a9a-46ba-b82e-c9e9561a0da1): created successfully Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e43eff-2cf2-4f00-985d-aa3719b9c50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Flow 'volume_create_manager' (bdc88798-f557-4c8e-889a-3e9bdc217b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cc9ab638-0164-4f47-ae76-5b0a14db7da4 tempest-TestServerVolumeAttachmentScenario-455283741 None] Created volume successfully. Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:45:09 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[949218d8-cf71-46ba-bab6-5749075665b1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:45:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:09 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD Sep 29 12:45:09 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Flow 'volume_create_manager' (4ad10b58-5ce6-43f6-9f05-d79d31059535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:10 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bec05b-11e1-411f-a517-e4ce694c6be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 1073741824" returned: 0 in 0.907s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bec05b-11e1-411f-a517-e4ce694c6be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-283759570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9082b40a-1172-4b35-9660-3a170e0b8249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe5f20ad3804c5989e0b8d254893eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:10Z,use_quota=True,user_id='efc19092842d478d8bbbc829c9fa158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098545d4-6987-4cdb-93de-0c40b7d8c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098545d4-6987-4cdb-93de-0c40b7d8c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e26ea-e55a-45d9-8021-c2761b19c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e26ea-e55a-45d9-8021-c2761b19c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9082b40a-1172-4b35-9660-3a170e0b8249', 'volume_name': 'volume-9082b40a-1172-4b35-9660-3a170e0b8249', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3af317-54cf-40c6-918c-2bbbcd178e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3af317-54cf-40c6-918c-2bbbcd178e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59970e7b-fa88-4131-8626-dad2e08303ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Volume 9082b40a-1172-4b35-9660-3a170e0b8249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9082b40a-1172-4b35-9660-3a170e0b8249', 'volume_size': 1} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 is fetched for user 2804bbac7c7745e9815e9a101618f11e. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:10 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 Sep 29 12:45:10 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc5c56-9727-46ce-bf25-fcb0c3d56bf0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:10 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD Sep 29 12:45:10 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:10 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7" returned: 0 in 0.276s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-283759570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9082b40a-1172-4b35-9660-3a170e0b8249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe5f20ad3804c5989e0b8d254893eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:10Z,use_quota=True,user_id='efc19092842d478d8bbbc829c9fa158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Creating volume 9082b40a-1172-4b35-9660-3a170e0b8249 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:45:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0778cc3c-925c-4da7-9b58-a7284f48bc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210c503f-50aa-4166-be5c-f306c7d76df7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bad117f-675a-4892-bd5d-f50b6974a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Volume volume-210c503f-50aa-4166-be5c-f306c7d76df7 (210c503f-50aa-4166-be5c-f306c7d76df7): created successfully Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bad117f-675a-4892-bd5d-f50b6974a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Flow 'volume_create_manager' (ef7bfeba-d2c1-4c3d-88cd-9746235ce530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fea234cc-002e-4804-9dca-13710574cdb0 tempest-TestServerVolumeAttachmentScenario-455283741 None] Created volume successfully. Sep 29 12:45:10 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 1073741824 Sep 29 12:45:10 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:10 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:11 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 1073741824" returned: 0 in 0.531s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:11 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 Sep 29 12:45:11 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:11 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1536934342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0d13f0-9a35-430c-825b-a48f3bcde8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d50c7e3c444bdb8c08507f29fcb165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:08Z,use_quota=True,user_id='2804bbac7c7745e9815e9a101618f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Creating volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:45:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59970e7b-fa88-4131-8626-dad2e08303ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9082b40a-1172-4b35-9660-3a170e0b8249', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c63d68-98b7-41ef-8de6-7f8c19fe1e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:11 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1073741824 Sep 29 12:45:11 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Volume volume-9082b40a-1172-4b35-9660-3a170e0b8249 (9082b40a-1172-4b35-9660-3a170e0b8249): created successfully Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c63d68-98b7-41ef-8de6-7f8c19fe1e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Flow 'volume_create_manager' (4ad10b58-5ce6-43f6-9f05-d79d31059535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a7a74e2d-b493-4745-a724-04bf48c59724 tempest-TestMinimumBasicScenario-1291691199 None] Created volume successfully. Sep 29 12:45:11 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1073741824" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:11 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 Sep 29 12:45:11 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:12 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" returned: 0 in 0.380s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Attempting download of 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff08f20a-4ad2-4e80-9ce9-6bb407e200e6]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:12 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro Sep 29 12:45:12 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:12 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro" returned: 0 in 0.487s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:13 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro Sep 29 12:45:13 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-df746043-d93b-48cd-8556-cc025af628e5 req-7bad0082-88be-4099-9ed0-5916fe6582db tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-df746043-d93b-48cd-8556-cc025af628e5 req-7bad0082-88be-4099-9ed0-5916fe6582db tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-df746043-d93b-48cd-8556-cc025af628e5 req-7bad0082-88be-4099-9ed0-5916fe6582db tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-df746043-d93b-48cd-8556-cc025af628e5 req-7bad0082-88be-4099-9ed0-5916fe6582db tempest-TestMinimumBasicScenario-1291691199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-9082b40a-1172-4b35-9660-3a170e0b8249', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84570e6e-e121-422e-a1ed-3a58a4b734eb', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:45:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-df746043-d93b-48cd-8556-cc025af628e5 req-7bad0082-88be-4099-9ed0-5916fe6582db tempest-TestMinimumBasicScenario-1291691199 None] attachment_update completed successfully. Sep 29 12:45:13 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro" returned: 1 in 0.522s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94feb733-57cd-4052-a12a-6ab2ace34da5_6hsucjro' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a5c347-7815-402c-a38e-d5bd503d4ef1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:13 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD Sep 29 12:45:13 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:13 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] 94feb733-57cd-4052-a12a-6ab2ace34da5 was qcow2, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:45:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:13 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 Sep 29 12:45:13 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:17 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" returned: 0 in 3.517s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:17 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94feb733-57cd-4052-a12a-6ab2ace34da5_urchespxdevstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:45:17 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Converted 112.00 MB image at 31.81 MB/s Sep 29 12:45:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:17 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1G Sep 29 12:45:17 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:17 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 1G" returned: 0 in 0.582s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Downloaded image 94feb733-57cd-4052-a12a-6ab2ace34da5 ((None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}])) to volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Temporary image 94feb733-57cd-4052-a12a-6ab2ace34da5 for user 2804bbac7c7745e9815e9a101618f11e is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Marking volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Copying metadata from image 94feb733-57cd-4052-a12a-6ab2ace34da5 to 3a0d13f0-9a35-430c-825b-a48f3bcde8d7. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Creating volume glance metadata for volume 3a0d13f0-9a35-430c-825b-a48f3bcde8d7 backed by image 94feb733-57cd-4052-a12a-6ab2ace34da5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64067842-4759-44ed-aa30-c665078865d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'volume_size': 1, 'image_id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94feb733-57cd-4052-a12a-6ab2ace34da5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02ac9aa5fed340839b2aeed248d9f93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94feb733-57cd-4052-a12a-6ab2ace34da5', 'created_at': datetime.datetime(2026, 9, 29, 10, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 25, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94feb733-57cd-4052-a12a-6ab2ace34da5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a61565-7564-44f5-bdc5-a1a34f4e3f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Volume volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 (3a0d13f0-9a35-430c-825b-a48f3bcde8d7): created successfully Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a61565-7564-44f5-bdc5-a1a34f4e3f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Flow 'volume_create_manager' (6be10919-6ffd-4991-a408-5ad62edb0425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2f7825af-b325-4375-94a8-712430bb7917 tempest-TestShelveInstance-1778842090 None] Created volume successfully. Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Flow 'volume_create_manager' (217db140-7a74-4b53-a6ef-a64ad5f71fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba49a27-c8bc-46e9-a0b5-274f0cebcee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba49a27-c8bc-46e9-a0b5-274f0cebcee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1329307386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7253bc-f918-45e5-b229-96542132efb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500c3c44e444d5b8f35396183952ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:25Z,use_quota=True,user_id='912d9cd9ab4745178b9f0e7768492476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0761e21c-e40a-43c2-a5e8-b44d3ba29cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0761e21c-e40a-43c2-a5e8-b44d3ba29cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd42122-6e02-4c2b-8f61-7c6abbffae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd42122-6e02-4c2b-8f61-7c6abbffae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7253bc-f918-45e5-b229-96542132efb1', 'volume_name': 'volume-de7253bc-f918-45e5-b229-96542132efb1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53159657-3b73-4f52-8236-067df18c84d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53159657-3b73-4f52-8236-067df18c84d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3a90bd-ad6f-4851-b267-b55453a90747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Volume de7253bc-f918-45e5-b229-96542132efb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7253bc-f918-45e5-b229-96542132efb1', 'volume_size': 1} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1329307386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7253bc-f918-45e5-b229-96542132efb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500c3c44e444d5b8f35396183952ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:25Z,use_quota=True,user_id='912d9cd9ab4745178b9f0e7768492476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Creating volume de7253bc-f918-45e5-b229-96542132efb1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:45:24 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:45:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:24 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 1073741824 Sep 29 12:45:24 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bf30c2c8-cce1-4974-a1af-479adf9b4f4c req-673767e0-3ddf-47d9-a5fb-914731c23da0 tempest-TestShelveInstance-1778842090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:25 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 1073741824" returned: 0 in 0.926s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:25 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 Sep 29 12:45:25 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:26 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1" returned: 0 in 0.555s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bf30c2c8-cce1-4974-a1af-479adf9b4f4c req-673767e0-3ddf-47d9-a5fb-914731c23da0 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.231s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3a90bd-ad6f-4851-b267-b55453a90747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7253bc-f918-45e5-b229-96542132efb1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dc7d16-40e5-46a5-93d2-01d73853ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-bf30c2c8-cce1-4974-a1af-479adf9b4f4c req-673767e0-3ddf-47d9-a5fb-914731c23da0 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Volume volume-de7253bc-f918-45e5-b229-96542132efb1 (de7253bc-f918-45e5-b229-96542132efb1): created successfully Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dc7d16-40e5-46a5-93d2-01d73853ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Flow 'volume_create_manager' (217db140-7a74-4b53-a6ef-a64ad5f71fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:45:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-70cfa725-a03e-4841-a97c-ce98e804e7b0 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Created volume successfully. Sep 29 12:45:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-bf30c2c8-cce1-4974-a1af-479adf9b4f4c req-673767e0-3ddf-47d9-a5fb-914731c23da0 tempest-TestShelveInstance-1778842090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64e20b85-d9dc-4230-be5c-e7426597ea56', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:45:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-bf30c2c8-cce1-4974-a1af-479adf9b4f4c req-673767e0-3ddf-47d9-a5fb-914731c23da0 tempest-TestShelveInstance-1778842090 None] attachment_update completed successfully. Sep 29 12:45:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-83bf98df-d1b4-467f-bfd0-b25b7ea0ab98 req-c42585a4-b4f3-4ae2-a019-a1d15f3073fd tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-83bf98df-d1b4-467f-bfd0-b25b7ea0ab98 req-c42585a4-b4f3-4ae2-a019-a1d15f3073fd tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-83bf98df-d1b4-467f-bfd0-b25b7ea0ab98 req-c42585a4-b4f3-4ae2-a019-a1d15f3073fd tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-83bf98df-d1b4-467f-bfd0-b25b7ea0ab98 req-c42585a4-b4f3-4ae2-a019-a1d15f3073fd tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-de7253bc-f918-45e5-b229-96542132efb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d8c0c42-3c30-4f94-bc90-a17865c87f7f', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:45:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-83bf98df-d1b4-467f-bfd0-b25b7ea0ab98 req-c42585a4-b4f3-4ae2-a019-a1d15f3073fd tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] attachment_update completed successfully. Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:30 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:45:30 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:30 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:45:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:45:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-dd9ec019-485f-4649-929e-e111a076d80d req-992f4e99-4e7d-427b-b05d-225332f91049 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Terminate volume connection completed successfully. Sep 29 12:45:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-dd9ec019-485f-4649-929e-e111a076d80d req-992f4e99-4e7d-427b-b05d-225332f91049 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Deleting attachment 3d8c0c42-3c30-4f94-bc90-a17865c87f7f. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "cinder-de7253bc-f918-45e5-b229-96542132efb1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "cinder-de7253bc-f918-45e5-b229-96542132efb1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "cinder-quobyte-de7253bc-f918-45e5-b229-96542132efb1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "cinder-quobyte-de7253bc-f918-45e5-b229-96542132efb1" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[76913092-c62e-4266-ac1a-7ece1af89a7b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:45:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:35 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 Sep 29 12:45:35 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:36 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:36 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1 Sep 29 12:45:36 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:36 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-de7253bc-f918-45e5-b229-96542132efb1" returned: 0 in 0.472s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "cinder-quobyte-de7253bc-f918-45e5-b229-96542132efb1" released by "delete_volume" :: held 0.982s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Created reservations ['bed55a14-b231-45e9-84a5-61ad0d2d0a62', '71fa8ab8-13cd-44d7-adf6-d592d51ef42f', 'c2dc726f-2ab2-41fa-8cf0-d47e04d69b20', '0c776c00-7ed5-4929-8e23-17b7c2d1ce80'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:45:36 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:45:36 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:45:37 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 29 12:45:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:45:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:45:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Deleted volume successfully. Sep 29 12:45:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8828876-7915-46df-bb50-fe15fc2e1649 tempest-TestServerVolumeAttachScenarioOldVersion-226851661 None] Lock "cinder-de7253bc-f918-45e5-b229-96542132efb1-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:45:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=27,cinder:SELECT=40,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:45:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=46,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:45:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d80d0b18-4e86-4067-88fa-1c7853d0651b req-43c7ff80-02b3-4377-abca-e6a36e78f146 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d80d0b18-4e86-4067-88fa-1c7853d0651b req-43c7ff80-02b3-4377-abca-e6a36e78f146 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d80d0b18-4e86-4067-88fa-1c7853d0651b req-43c7ff80-02b3-4377-abca-e6a36e78f146 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d80d0b18-4e86-4067-88fa-1c7853d0651b req-43c7ff80-02b3-4377-abca-e6a36e78f146 tempest-TestServerVolumeAttachmentScenario-455283741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eab8dc4-f4ed-4939-af1e-fcd5752a8154', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:45:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d80d0b18-4e86-4067-88fa-1c7853d0651b req-43c7ff80-02b3-4377-abca-e6a36e78f146 tempest-TestServerVolumeAttachmentScenario-455283741 None] attachment_update completed successfully. Sep 29 12:45:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b675cc0d-a310-4a23-a465-6334489c9e08 req-480108fa-4750-419e-b6b0-37c81c5ae22b tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:45:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b675cc0d-a310-4a23-a465-6334489c9e08 req-480108fa-4750-419e-b6b0-37c81c5ae22b tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:45:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b675cc0d-a310-4a23-a465-6334489c9e08 req-480108fa-4750-419e-b6b0-37c81c5ae22b tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:45:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-b675cc0d-a310-4a23-a465-6334489c9e08 req-480108fa-4750-419e-b6b0-37c81c5ae22b tempest-TestServerVolumeAttachmentScenario-455283741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-210c503f-50aa-4166-be5c-f306c7d76df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c823b101-ca85-42bc-99b4-b832cb342b40', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:45:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-b675cc0d-a310-4a23-a465-6334489c9e08 req-480108fa-4750-419e-b6b0-37c81c5ae22b tempest-TestServerVolumeAttachmentScenario-455283741 None] attachment_update completed successfully. Sep 29 12:45:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-ec59c649-7b1f-44ca-be14-48d47c64f655 req-95c62441-45d9-41e3-9758-6fe393a926ba tempest-TestServerVolumeAttachmentScenario-455283741 None] Terminate volume connection completed successfully. Sep 29 12:45:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-ec59c649-7b1f-44ca-be14-48d47c64f655 req-95c62441-45d9-41e3-9758-6fe393a926ba tempest-TestServerVolumeAttachmentScenario-455283741 None] Deleting attachment c823b101-ca85-42bc-99b4-b832cb342b40. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:46:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-f2b953b5-adc2-4821-abae-e4a03b7ea667 req-82725b3e-c102-4716-80f7-7d0105202119 tempest-TestServerVolumeAttachmentScenario-455283741 None] Terminate volume connection completed successfully. Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-f2b953b5-adc2-4821-abae-e4a03b7ea667 req-82725b3e-c102-4716-80f7-7d0105202119 tempest-TestServerVolumeAttachmentScenario-455283741 None] Deleting attachment 3eab8dc4-f4ed-4939-af1e-fcd5752a8154. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (4abb9195-cf71-41b7-b39f-7436f04a521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84edd10-3225-4ea2-bf7d-2503361027b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84edd10-3225-4ea2-bf7d-2503361027b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-514811030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa47247-03ba-44fd-9c49-fce833c87915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:00Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a86968-1994-41aa-b0fa-3e4678f83d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a86968-1994-41aa-b0fa-3e4678f83d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec428c0-a5df-4ecc-845b-cef6019d2b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec428c0-a5df-4ecc-845b-cef6019d2b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa47247-03ba-44fd-9c49-fce833c87915', 'volume_name': 'volume-6aa47247-03ba-44fd-9c49-fce833c87915', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8842c8aa-634a-4f5d-a52e-8934a42367c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8842c8aa-634a-4f5d-a52e-8934a42367c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cf9a4-2437-4a7d-b2dc-a78a5006ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume 6aa47247-03ba-44fd-9c49-fce833c87915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa47247-03ba-44fd-9c49-fce833c87915', 'volume_size': 1} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-514811030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa47247-03ba-44fd-9c49-fce833c87915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:00Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume 6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:00 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 1073741824 Sep 29 12:46:00 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:00 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 1073741824" returned: 0 in 0.475s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:00 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 Sep 29 12:46:00 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:01 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cf9a4-2437-4a7d-b2dc-a78a5006ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa47247-03ba-44fd-9c49-fce833c87915', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa6df6-692c-4d6b-a7c2-a594adc39471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-6aa47247-03ba-44fd-9c49-fce833c87915 (6aa47247-03ba-44fd-9c49-fce833c87915): created successfully Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa6df6-692c-4d6b-a7c2-a594adc39471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (4abb9195-cf71-41b7-b39f-7436f04a521e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0fe2c12d-139f-4cd2-8859-651b1c058482 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating offline snapshot 4690a101-1495-44b2-9be4-35b2cb305745 of volume 6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:46:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a376cf-6f69-4e2b-a790-c9170100dbe8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:03 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 Sep 29 12:46:03 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:03 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915" returned: 0 in 0.628s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:03 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 1G Sep 29 12:46:03 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:04 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 1G" returned: 0 in 0.535s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa47247-03ba-44fd-9c49-fce833c87915 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:04 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa47247-03ba-44fd-9c49-fce833c87915 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 Sep 29 12:46:04 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:04 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa47247-03ba-44fd-9c49-fce833c87915 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745" returned: 0 in 0.394s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:04 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 is being set with open permissions: ugo+rw Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:04 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 Sep 29 12:46:04 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:04 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745" returned: 0 in 0.354s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:04 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info Sep 29 12:46:04 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:05 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:05 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info is being set with open permissions: ugo+rw Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:05 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info Sep 29 12:46:05 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "cinder-210c503f-50aa-4166-be5c-f306c7d76df7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-210c503f-50aa-4166-be5c-f306c7d76df7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "cinder-quobyte-210c503f-50aa-4166-be5c-f306c7d76df7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-quobyte-210c503f-50aa-4166-be5c-f306c7d76df7" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6416f44-5aeb-4a03-9342-5b4609c8e7cd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:05 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.info" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:05 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 Sep 29 12:46:05 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-636e5542-4b34-4078-a011-c08b00db1725 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Create snapshot completed successfully Sep 29 12:46:06 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7" returned: 0 in 0.546s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:06 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7 Sep 29 12:46:06 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:06 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-210c503f-50aa-4166-be5c-f306c7d76df7" returned: 0 in 0.491s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-quobyte-210c503f-50aa-4166-be5c-f306c7d76df7" released by "delete_volume" :: held 1.112s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Created reservations ['ec0f221e-41f4-4069-936b-0eac8f9a59db', '0ee96e97-2d04-4f42-9d69-9966416c0a8a', '4cb7c24b-4b7d-44e9-85cb-2f43559d21b6', '11f1f5f9-5821-4053-aa7c-1ec4548e527f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:06 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:06 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (b1b8d299-b2c5-4aac-b4e8-df0bfa8aeb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f83853-e1a7-45cd-90c1-c8f62c976d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f83853-e1a7-45cd-90c1-c8f62c976d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908707046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e3c2ad-bf35-462e-b760-26856137d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:07Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb45a47-7a2c-4329-8c28-008ba8463541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb45a47-7a2c-4329-8c28-008ba8463541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f30551a-b3d3-45da-8115-59f94f1131fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f30551a-b3d3-45da-8115-59f94f1131fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e3c2ad-bf35-462e-b760-26856137d88a', 'volume_name': 'volume-13e3c2ad-bf35-462e-b760-26856137d88a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd43205-a523-4290-b1d9-8ba8603a8148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd43205-a523-4290-b1d9-8ba8603a8148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d1ce0-7b95-4562-a26e-f8d2b30ef63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume 13e3c2ad-bf35-462e-b760-26856137d88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e3c2ad-bf35-462e-b760-26856137d88a', 'volume_size': 1} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908707046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e3c2ad-bf35-462e-b760-26856137d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:07Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume 13e3c2ad-bf35-462e-b760-26856137d88a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:07 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a 1073741824 Sep 29 12:46:07 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:07 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Deleted volume successfully. Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dfff1150-562f-46e3-a45c-a627ccb44336 tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-210c503f-50aa-4166-be5c-f306c7d76df7-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (6dffd629-100e-43f8-9fbf-9ce55fc2a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d1f619-88f0-48cf-91f9-b3693a2ed10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d1f619-88f0-48cf-91f9-b3693a2ed10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349657116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e7a6ad-ccda-4653-98a3-e7970ebb6e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:07Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2e444f-9d65-43fd-b758-f0bf5e7573c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2e444f-9d65-43fd-b758-f0bf5e7573c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d107dec-07e8-4948-a067-8ee15dccca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d107dec-07e8-4948-a067-8ee15dccca2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e7a6ad-ccda-4653-98a3-e7970ebb6e40', 'volume_name': 'volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6002cb54-227f-431e-99c5-3b18a7cb19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6002cb54-227f-431e-99c5-3b18a7cb19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111aa816-777a-4f85-bed6-10e6f4be8fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume e9e7a6ad-ccda-4653-98a3-e7970ebb6e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40', 'volume_size': 1} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "cinder-069b818d-5a9a-46ba-b82e-c9e9561a0da1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:07 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a 1073741824" returned: 0 in 0.766s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-069b818d-5a9a-46ba-b82e-c9e9561a0da1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:07 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "cinder-quobyte-069b818d-5a9a-46ba-b82e-c9e9561a0da1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:07 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-quobyte-069b818d-5a9a-46ba-b82e-c9e9561a0da1" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1178c559-cb63-4345-a4f7-cc2f5fb1fd67]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (6ed77ad4-66e7-4f16-ab2a-bd3a0c8e4944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e2320c-0936-4bfc-a446-d24d9967e7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e2320c-0936-4bfc-a446-d24d9967e7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700172204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d164b03-8ac3-4605-b256-7dba1469f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:08Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e5399c-2ae1-4a0e-809d-ceaf7251a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 Sep 29 12:46:08 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e5399c-2ae1-4a0e-809d-ceaf7251a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce2d33-0a50-4671-b3c0-3aa7083c26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce2d33-0a50-4671-b3c0-3aa7083c26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d164b03-8ac3-4605-b256-7dba1469f58d', 'volume_name': 'volume-1d164b03-8ac3-4605-b256-7dba1469f58d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded8768-df39-49c5-95f5-d1b592160d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded8768-df39-49c5-95f5-d1b592160d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab711834-bfef-4f27-b0df-dbdeca90eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume 1d164b03-8ac3-4605-b256-7dba1469f58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d164b03-8ac3-4605-b256-7dba1469f58d', 'volume_size': 1} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:08 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a" returned: 0 in 0.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349657116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e7a6ad-ccda-4653-98a3-e7970ebb6e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:07Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:08 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d1ce0-7b95-4562-a26e-f8d2b30ef63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e3c2ad-bf35-462e-b760-26856137d88a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 1073741824 Sep 29 12:46:08 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caa2fa5-53c4-418c-800b-39faeeab80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-13e3c2ad-bf35-462e-b760-26856137d88a (13e3c2ad-bf35-462e-b760-26856137d88a): created successfully Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caa2fa5-53c4-418c-800b-39faeeab80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (b1b8d299-b2c5-4aac-b4e8-df0bfa8aeb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e3874e3d-8f6b-4d1b-b892-93ab192906c4 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-2dcdcfb6-4b6c-4f48-acd1-642a49850354 req-a8dd38e0-8139-4d65-8164-c1fa8574efcb tempest-TestMinimumBasicScenario-1291691199 None] Terminate volume connection completed successfully. Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-2dcdcfb6-4b6c-4f48-acd1-642a49850354 req-a8dd38e0-8139-4d65-8164-c1fa8574efcb tempest-TestMinimumBasicScenario-1291691199 None] Deleting attachment 84570e6e-e121-422e-a1ed-3a58a4b734eb. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:46:08 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1" returned: 0 in 0.757s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:08 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1 Sep 29 12:46:08 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:09 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 1073741824" returned: 0 in 0.741s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (fa19bb79-6082-4c0e-9e02-b31496f2c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf7bed-d4e6-4ee2-965f-7cd38231ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf7bed-d4e6-4ee2-965f-7cd38231ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819133080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b6503f-45b4-403e-8327-ebcbaea9907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:09Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1751f78-b26a-4f8b-8c61-de6a4ff15c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1751f78-b26a-4f8b-8c61-de6a4ff15c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beded221-9acd-43a1-9ca2-4885a57adf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beded221-9acd-43a1-9ca2-4885a57adf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b6503f-45b4-403e-8327-ebcbaea9907e', 'volume_name': 'volume-61b6503f-45b4-403e-8327-ebcbaea9907e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47578a0a-9c5f-4a7d-acb3-271bea51b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47578a0a-9c5f-4a7d-acb3-271bea51b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23614e6b-b635-4866-814c-ba03900f0678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume 61b6503f-45b4-403e-8327-ebcbaea9907e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b6503f-45b4-403e-8327-ebcbaea9907e', 'volume_size': 1} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-069b818d-5a9a-46ba-b82e-c9e9561a0da1" returned: 0 in 0.422s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-quobyte-069b818d-5a9a-46ba-b82e-c9e9561a0da1" released by "delete_volume" :: held 1.262s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:09 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 Sep 29 12:46:09 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (c4f1f620-1fe8-47b3-a16c-d2318b89641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc08421-d66d-4e15-8d71-1c0202b1ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc08421-d66d-4e15-8d71-1c0202b1ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348002407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71349e6c-8877-41cf-9ece-58d43be70be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:09Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4f50cf-8726-4e5b-9713-3709ccee0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4f50cf-8726-4e5b-9713-3709ccee0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1643ffc-1589-4efb-85c3-d6b9d6e7141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1643ffc-1589-4efb-85c3-d6b9d6e7141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71349e6c-8877-41cf-9ece-58d43be70be3', 'volume_name': 'volume-71349e6c-8877-41cf-9ece-58d43be70be3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a71cf-40b2-4824-813b-f9a57a79faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a71cf-40b2-4824-813b-f9a57a79faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa3387-3777-475e-a793-19cd4654220f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume 71349e6c-8877-41cf-9ece-58d43be70be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71349e6c-8877-41cf-9ece-58d43be70be3', 'volume_size': 1} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Created reservations ['fb9fbdb5-ea4a-4c59-9032-74dd504f05b8', '8c26477e-da6c-4be5-ba3e-fcc179ea4dcb', 'e3cbe58f-9d52-4ea5-bff2-4c52fdf9dbde', 'c92a4019-e90e-42a4-9fbf-4d13621d1f4c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:09 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:09 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:09 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700172204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d164b03-8ac3-4605-b256-7dba1469f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:08Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume 1d164b03-8ac3-4605-b256-7dba1469f58d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111aa816-777a-4f85-bed6-10e6f4be8fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae9e3c-13ea-46ea-b1c4-b1ee98d875bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:09 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d 1073741824 Sep 29 12:46:09 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 (e9e7a6ad-ccda-4653-98a3-e7970ebb6e40): created successfully Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae9e3c-13ea-46ea-b1c4-b1ee98d875bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (6dffd629-100e-43f8-9fbf-9ce55fc2a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-51151c87-0888-4606-9308-1936c81fefc2 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:09 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.274s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Deleted volume successfully. Sep 29 12:46:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f967399a-9a79-49c9-8dd5-2a95b192498c tempest-TestServerVolumeAttachmentScenario-455283741 None] Lock "cinder-069b818d-5a9a-46ba-b82e-c9e9561a0da1-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:10 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d 1073741824" returned: 0 in 0.458s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:10 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d Sep 29 12:46:10 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "cinder-9082b40a-1172-4b35-9660-3a170e0b8249-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "cinder-9082b40a-1172-4b35-9660-3a170e0b8249-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "cinder-quobyte-9082b40a-1172-4b35-9660-3a170e0b8249" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:10 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d" returned: 0 in 0.353s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819133080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b6503f-45b4-403e-8327-ebcbaea9907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:09Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume 61b6503f-45b4-403e-8327-ebcbaea9907e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab711834-bfef-4f27-b0df-dbdeca90eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d164b03-8ac3-4605-b256-7dba1469f58d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:10 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e 1073741824 Sep 29 12:46:10 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5378438f-5d07-4422-8d58-5e9c7dab2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "cinder-quobyte-9082b40a-1172-4b35-9660-3a170e0b8249" acquired by "delete_volume" :: waited 0.069s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-1d164b03-8ac3-4605-b256-7dba1469f58d (1d164b03-8ac3-4605-b256-7dba1469f58d): created successfully Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5378438f-5d07-4422-8d58-5e9c7dab2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (6ed77ad4-66e7-4f16-ab2a-bd3a0c8e4944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad34b2c-721e-4b5f-bdab-bcb46bdcb093]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-34c81a96-bf6e-452c-bae8-7f82165f4ab0 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:10 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 Sep 29 12:46:10 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:10 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249" returned: 0 in 0.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:10 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e 1073741824" returned: 0 in 0.493s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:10 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249 Sep 29 12:46:10 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:10 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e Sep 29 12:46:10 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:11 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9082b40a-1172-4b35-9660-3a170e0b8249" returned: 0 in 0.307s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "cinder-quobyte-9082b40a-1172-4b35-9660-3a170e0b8249" released by "delete_volume" :: held 0.771s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:11 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e" returned: 0 in 0.320s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348002407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71349e6c-8877-41cf-9ece-58d43be70be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dec4e15b2dc4580b5aa7802d0c4433c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:09Z,use_quota=True,user_id='335765f5206647a3b9658c8cf14be1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Creating volume 71349e6c-8877-41cf-9ece-58d43be70be3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23614e6b-b635-4866-814c-ba03900f0678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b6503f-45b4-403e-8327-ebcbaea9907e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac64a488-f303-48ff-bf11-701e843d6577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:11 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 1073741824 Sep 29 12:46:11 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-61b6503f-45b4-403e-8327-ebcbaea9907e (61b6503f-45b4-403e-8327-ebcbaea9907e): created successfully Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac64a488-f303-48ff-bf11-701e843d6577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (fa19bb79-6082-4c0e-9e02-b31496f2c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Created reservations ['f155ea9c-2ab7-416d-a711-2fe663f341dd', 'bffe24f6-94db-4bed-b2b5-493d305e294c', '89dc6094-05b0-4a4e-806d-7beb9b7ac456', '5672daa6-aeab-48e1-be73-5cc50eee9b67'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d207b6dd-2339-4433-894d-f0b59acda8a1 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:11 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:11 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:11 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Deleted volume successfully. Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-80b26da0-74db-4811-a9da-3e40154c50df tempest-TestMinimumBasicScenario-1291691199 None] Lock "cinder-9082b40a-1172-4b35-9660-3a170e0b8249-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:11 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 1073741824" returned: 0 in 0.695s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:12 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 Sep 29 12:46:12 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:12 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3" returned: 0 in 0.496s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa3387-3777-475e-a793-19cd4654220f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71349e6c-8877-41cf-9ece-58d43be70be3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bba4e91-ed4f-4bff-9a14-5cded001769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Volume volume-71349e6c-8877-41cf-9ece-58d43be70be3 (71349e6c-8877-41cf-9ece-58d43be70be3): created successfully Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bba4e91-ed4f-4bff-9a14-5cded001769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Flow 'volume_create_manager' (c4f1f620-1fe8-47b3-a16c-d2318b89641d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5381a679-083f-452f-a4a2-45802cc8d38a tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created volume successfully. Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-71349e6c-8877-41cf-9ece-58d43be70be3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-71349e6c-8877-41cf-9ece-58d43be70be3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-71349e6c-8877-41cf-9ece-58d43be70be3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-71349e6c-8877-41cf-9ece-58d43be70be3" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ceb0da-2da1-41c3-af8a-861b6a509228]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:14 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 Sep 29 12:46:14 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:14 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3" returned: 0 in 0.528s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:14 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3 Sep 29 12:46:14 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:14 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-71349e6c-8877-41cf-9ece-58d43be70be3" returned: 0 in 0.279s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-71349e6c-8877-41cf-9ece-58d43be70be3" released by "delete_volume" :: held 0.866s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['3d407703-b624-446c-ba62-9be9baacf593', '41f08638-2e6f-4415-88e1-b1e3d0936701', 'd9114594-4fbb-4cf8-a90c-1d3d3b47caed', 'd27b1677-cd13-48d9-b71e-649f3c26c377'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:14 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:14 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-61b6503f-45b4-403e-8327-ebcbaea9907e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-61b6503f-45b4-403e-8327-ebcbaea9907e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-61b6503f-45b4-403e-8327-ebcbaea9907e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-61b6503f-45b4-403e-8327-ebcbaea9907e" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915e46b-d0cb-4fc0-a829-7dc71237f4e3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:15 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-71ba40cf-89f4-4a9b-aa23-76b3a24f905d tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-71349e6c-8877-41cf-9ece-58d43be70be3-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:15 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e Sep 29 12:46:15 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:15 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e" returned: 0 in 0.547s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:15 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e Sep 29 12:46:15 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:16 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-61b6503f-45b4-403e-8327-ebcbaea9907e" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-61b6503f-45b4-403e-8327-ebcbaea9907e" released by "delete_volume" :: held 0.920s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['eca40deb-afa0-4353-b2c6-93317b874fad', 'edf0a223-2ed3-462f-9da3-3b20c45a8486', 'e7ebfcfe-cc75-4675-a850-593e6cc9063b', '4d191850-4bf4-41de-81da-e5556a2bf841'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:16 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:16 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-1d164b03-8ac3-4605-b256-7dba1469f58d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-1d164b03-8ac3-4605-b256-7dba1469f58d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-1d164b03-8ac3-4605-b256-7dba1469f58d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-1d164b03-8ac3-4605-b256-7dba1469f58d" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[211aa370-0158-4992-959d-d87be72ddc40]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:16 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d Sep 29 12:46:16 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:16 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.489s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32df6033-932e-4716-9ad0-e9f68ec6acde tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-61b6503f-45b4-403e-8327-ebcbaea9907e-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:16 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:17 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d Sep 29 12:46:17 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:17 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1d164b03-8ac3-4605-b256-7dba1469f58d" returned: 0 in 0.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-1d164b03-8ac3-4605-b256-7dba1469f58d" released by "delete_volume" :: held 0.898s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['1a4df976-227d-4148-bdd7-df1682205fb9', 'b7193c78-3e17-43d8-b64a-509a261eabd4', '816964d9-5dcf-4490-9902-ac4093c36c9a', '2144fd33-5ec9-47b4-8524-b7393f1281c3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:17 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:17 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa342b87-f6b3-4d11-8d83-e335b5141228]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:17 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 Sep 29 12:46:17 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:18 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.489s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f12421a0-fc55-436d-afc2-72f5847c27ec tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-1d164b03-8ac3-4605-b256-7dba1469f58d-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:18 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:18 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40 Sep 29 12:46:18 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:18 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" returned: 0 in 0.296s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40" released by "delete_volume" :: held 0.919s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['b4d58c0e-7017-4b0e-8b26-b9e030416a91', '85ffd3a0-e43a-4093-883a-99174227d0cf', '0816c33a-f3c8-45b9-bcc1-0610e6eea920', '63609f40-2037-439f-b711-ed01c3979b21'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:18 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:18 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:19 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.330s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e4ad870f-c46d-4589-887c-a6ad50faa22b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-e9e7a6ad-ccda-4653-98a3-e7970ebb6e40-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-13e3c2ad-bf35-462e-b760-26856137d88a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-13e3c2ad-bf35-462e-b760-26856137d88a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-13e3c2ad-bf35-462e-b760-26856137d88a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-13e3c2ad-bf35-462e-b760-26856137d88a" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0a3c0-8999-4c9e-9325-c5e49f5f7738]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:20 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a Sep 29 12:46:20 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:20 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a" returned: 0 in 0.575s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:20 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a Sep 29 12:46:20 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:20 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-13e3c2ad-bf35-462e-b760-26856137d88a" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-13e3c2ad-bf35-462e-b760-26856137d88a" released by "delete_volume" :: held 0.929s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['4c37f189-19c4-44c1-83a7-01099c3c61b3', '0742d9a9-7277-4190-86da-18ae48b797b0', 'd01700a5-c0e6-4e5f-8103-5490c0ea9e32', '800b278c-88e6-4884-adf1-8d9c07123775'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:21 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:21 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:21 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2efbdccf-ecb4-48a7-a25a-7c974ca1a0d7 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-13e3c2ad-bf35-462e-b760-26856137d88a-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-4690a101-1495-44b2-9be4-35b2cb305745-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-4690a101-1495-44b2-9be4-35b2cb305745-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-4690a101-1495-44b2-9be4-35b2cb305745" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-4690a101-1495-44b2-9be4-35b2cb305745" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleting offline snapshot 4690a101-1495-44b2-9be4-35b2cb305745 of volume 6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] snapshot_file for this snap is: volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5692907-a581-4d8f-9697-ba23afe5d88f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:22 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 Sep 29 12:46:22 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:22 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa47247-03ba-44fd-9c49-fce833c87915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310f3d6-bd5f-4aff-9513-0bbc4dfb8bf2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:23 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 Sep 29 12:46:23 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:23 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:23 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 Sep 29 12:46:23 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:23 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745" returned: 0 in 0.520s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:23 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745 Sep 29 12:46:23 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:24 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915.4690a101-1495-44b2-9be4-35b2cb305745" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-4690a101-1495-44b2-9be4-35b2cb305745" released by "_delete_snapshot" :: held 1.942s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" released by "delete_snapshot" :: held 1.973s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['f95dfe40-eddb-49bd-b21b-3865c57a6971', '2680790b-4893-43f9-90ba-244d21ef8b5e', '082b2bfa-a873-4304-b2b1-d4027a703ae7', 'b0329b9a-759a-4c9b-a5f7-9931153b87d3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Delete snapshot completed successfully. Sep 29 12:46:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c33f785f-acb7-4139-89b7-a8ae279a6903 tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-4690a101-1495-44b2-9be4-35b2cb305745-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-cd50b263-395f-468d-a99d-38072116ec58 req-2c6672e6-cd94-404a-b2d6-36ae68381114 tempest-TestShelveInstance-1778842090 None] Terminate volume connection completed successfully. Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-cd50b263-395f-468d-a99d-38072116ec58 req-2c6672e6-cd94-404a-b2d6-36ae68381114 tempest-TestShelveInstance-1778842090 None] Deleting attachment 64e20b85-d9dc-4230-be5c-e7426597ea56. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-6aa47247-03ba-44fd-9c49-fce833c87915-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-6aa47247-03ba-44fd-9c49-fce833c87915-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e6e404-b024-4328-95de-a348fda141d6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:25 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 Sep 29 12:46:25 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:26 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915" returned: 0 in 0.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:26 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915 Sep 29 12:46:26 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:26 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6aa47247-03ba-44fd-9c49-fce833c87915" returned: 0 in 0.302s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-quobyte-6aa47247-03ba-44fd-9c49-fce833c87915" released by "delete_volume" :: held 0.853s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Created reservations ['a8f337b9-7ac5-498e-9fec-fa93a7856a68', 'e1c6609e-6b7e-4fda-8b4c-7addf2f58e7d', '78817946-e545-479f-8ace-13bbf8384989', 'f1e97951-c514-4513-a107-c19b86fc3782'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:26 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:26 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:26 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Deleted volume successfully. Sep 29 12:46:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ea6060c-c8d6-42f7-b334-35eda691b83b tempest-CreateVolumesFromSnapshotTest-1684627683 None] Lock "cinder-6aa47247-03ba-44fd-9c49-fce833c87915-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (885a6c0a-1f81-4374-ac25-7bfed848543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26315146-0eff-4379-819e-ef117af05511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26315146-0eff-4379-819e-ef117af05511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141102020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c8f5fe-9f50-47c5-8137-7df39c8769b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:28Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998734a-bd6e-4f8d-a162-6d1746a8250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998734a-bd6e-4f8d-a162-6d1746a8250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2c7554-27e4-4301-9a54-56c2092718bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2c7554-27e4-4301-9a54-56c2092718bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c8f5fe-9f50-47c5-8137-7df39c8769b6', 'volume_name': 'volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e79c6-401b-48e7-8b93-f5c34cbab591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e79c6-401b-48e7-8b93-f5c34cbab591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b068c-968c-46e7-bcef-5e115fdd4b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume 93c8f5fe-9f50-47c5-8137-7df39c8769b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6', 'volume_size': 1} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141102020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c8f5fe-9f50-47c5-8137-7df39c8769b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:28Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume 93c8f5fe-9f50-47c5-8137-7df39c8769b6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:28 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 1073741824 Sep 29 12:46:28 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-88845afd-a060-4b39-9245-0a0f9355fdfb req-a3691157-e673-45ce-a24f-216147ab4905 tempest-TestShelveInstance-1778842090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:29 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 1073741824" returned: 0 in 0.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:29 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 Sep 29 12:46:29 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:29 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-88845afd-a060-4b39-9245-0a0f9355fdfb req-a3691157-e673-45ce-a24f-216147ab4905 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.340s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-88845afd-a060-4b39-9245-0a0f9355fdfb req-a3691157-e673-45ce-a24f-216147ab4905 tempest-TestShelveInstance-1778842090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b068c-968c-46e7-bcef-5e115fdd4b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248d452-7adb-4bc6-bb46-30e26ba06942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-88845afd-a060-4b39-9245-0a0f9355fdfb req-a3691157-e673-45ce-a24f-216147ab4905 tempest-TestShelveInstance-1778842090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa5d4ba2-0ec8-4529-a0d8-3de986532c19', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:46:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 (93c8f5fe-9f50-47c5-8137-7df39c8769b6): created successfully Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248d452-7adb-4bc6-bb46-30e26ba06942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (885a6c0a-1f81-4374-ac25-7bfed848543c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cd13a74e-43df-43bd-a5be-532200fc6431 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-88845afd-a060-4b39-9245-0a0f9355fdfb req-a3691157-e673-45ce-a24f-216147ab4905 tempest-TestShelveInstance-1778842090 None] attachment_update completed successfully. Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:30 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:30 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:30 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.443s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:46:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (f4e5c822-1f21-4afe-a1ba-93f42b1093c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f101d65a-1d81-423b-a015-bcc08198e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f101d65a-1d81-423b-a015-bcc08198e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1642661748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441adbeb-824f-41db-b722-80be159ae6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:31Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b06ca5-41a3-4546-b853-c940e632598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b06ca5-41a3-4546-b853-c940e632598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa0090f-461f-4849-9b63-8bb2483bf98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa0090f-461f-4849-9b63-8bb2483bf98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441adbeb-824f-41db-b722-80be159ae6a7', 'volume_name': 'volume-441adbeb-824f-41db-b722-80be159ae6a7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6027960-f408-4d8f-b711-5a048c906022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6027960-f408-4d8f-b711-5a048c906022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab86d48-3b4a-432d-a3f1-26f739f1e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume 441adbeb-824f-41db-b722-80be159ae6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441adbeb-824f-41db-b722-80be159ae6a7', 'volume_size': 1} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1642661748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441adbeb-824f-41db-b722-80be159ae6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:31Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume 441adbeb-824f-41db-b722-80be159ae6a7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:31 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:31 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 1073741824 Sep 29 12:46:31 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (6a95d27b-c27e-4c1e-85c5-c3ab60724e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc1fcfc-142f-4e16-a715-a71a2f1c2e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc1fcfc-142f-4e16-a715-a71a2f1c2e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089527873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a6868c-71c5-4e50-a3ad-53dfbce4f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:32Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb64a57-0501-4b5b-93fe-5639fc21300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb64a57-0501-4b5b-93fe-5639fc21300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce496e35-b77d-4fc4-95ba-cd8eb51d2787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce496e35-b77d-4fc4-95ba-cd8eb51d2787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a6868c-71c5-4e50-a3ad-53dfbce4f138', 'volume_name': 'volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e045136-ecba-4d86-a16b-da0d760535f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e045136-ecba-4d86-a16b-da0d760535f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e62116-5a39-463e-89b6-f17fdef7ab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume a9a6868c-71c5-4e50-a3ad-53dfbce4f138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138', 'volume_size': 1} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:32 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 1073741824" returned: 0 in 0.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:32 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 Sep 29 12:46:32 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (3bd49215-5b28-4e35-b658-98cc314cf6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d48bccc-5e1f-4603-a689-b49fc28dbfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d48bccc-5e1f-4603-a689-b49fc28dbfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540838356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9836fcd-bc7a-471c-86dd-3d6165541739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:33Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef67589-dee0-41c6-8cdc-521edd6ee874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef67589-dee0-41c6-8cdc-521edd6ee874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd2e76e-cc96-4803-8743-9dadb6e57f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd2e76e-cc96-4803-8743-9dadb6e57f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9836fcd-bc7a-471c-86dd-3d6165541739', 'volume_name': 'volume-a9836fcd-bc7a-471c-86dd-3d6165541739', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0259d1a3-3a94-4013-a16b-4e9424e4912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0259d1a3-3a94-4013-a16b-4e9424e4912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa08ee1b-63a5-432f-92a7-c9b8750cb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume a9836fcd-bc7a-471c-86dd-3d6165541739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9836fcd-bc7a-471c-86dd-3d6165541739', 'volume_size': 1} Sep 29 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:33 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7" returned: 0 in 0.506s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089527873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a6868c-71c5-4e50-a3ad-53dfbce4f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:32Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume a9a6868c-71c5-4e50-a3ad-53dfbce4f138 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab86d48-3b4a-432d-a3f1-26f739f1e43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441adbeb-824f-41db-b722-80be159ae6a7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca4eea0-eee8-4cca-a003-f0c8c031b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-441adbeb-824f-41db-b722-80be159ae6a7 (441adbeb-824f-41db-b722-80be159ae6a7): created successfully Sep 29 12:46:33 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 1073741824 Sep 29 12:46:33 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca4eea0-eee8-4cca-a003-f0c8c031b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (f4e5c822-1f21-4afe-a1ba-93f42b1093c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-777a4973-56ef-498f-af23-5faee62a5132 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (24f18031-ad4e-49a7-b3ca-cc5908c9159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c2878c-4cb3-4f59-b083-cd9bf4aa83b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c2878c-4cb3-4f59-b083-cd9bf4aa83b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062725092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b822eb8-392c-4b74-8e64-9eafbaec27c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:33Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18b3810-7ccf-4ea9-b477-ab9e42ed25ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18b3810-7ccf-4ea9-b477-ab9e42ed25ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9307eafc-9c7f-4aa5-9f37-511cd431c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9307eafc-9c7f-4aa5-9f37-511cd431c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b822eb8-392c-4b74-8e64-9eafbaec27c6', 'volume_name': 'volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e2baa0-0433-4bc2-be27-6b63da3beb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e2baa0-0433-4bc2-be27-6b63da3beb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405ec7c9-9b87-4445-9397-fa07a75b8064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume 9b822eb8-392c-4b74-8e64-9eafbaec27c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6', 'volume_size': 1} Sep 29 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:34 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 1073741824" returned: 0 in 0.985s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:34 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 Sep 29 12:46:34 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (1a8185dc-c6e4-4a72-b6e3-d7a69284cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596d6aa-a907-4709-90fd-ee05eb5bc81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596d6aa-a907-4709-90fd-ee05eb5bc81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276487744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3449af-55ef-4c92-8f58-7d8fa0169736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:34Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b90e875-5f9e-4908-b58f-2d86e32363e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b90e875-5f9e-4908-b58f-2d86e32363e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bd5493-f309-42ef-a319-2ca7e5c35dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bd5493-f309-42ef-a319-2ca7e5c35dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3449af-55ef-4c92-8f58-7d8fa0169736', 'volume_name': 'volume-7c3449af-55ef-4c92-8f58-7d8fa0169736', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f080d08-5014-42e6-bead-995ef376c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f080d08-5014-42e6-bead-995ef376c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e52214-0ba2-46da-9598-a522c45f118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume 7c3449af-55ef-4c92-8f58-7d8fa0169736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3449af-55ef-4c92-8f58-7d8fa0169736', 'volume_size': 1} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:34 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" returned: 0 in 0.477s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540838356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9836fcd-bc7a-471c-86dd-3d6165541739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:33Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume a9836fcd-bc7a-471c-86dd-3d6165541739 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e62116-5a39-463e-89b6-f17fdef7ab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 1073741824 Sep 29 12:46:34 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970ef80c-3b93-4b65-b29f-aa112bdae91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 (a9a6868c-71c5-4e50-a3ad-53dfbce4f138): created successfully Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970ef80c-3b93-4b65-b29f-aa112bdae91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (6a95d27b-c27e-4c1e-85c5-c3ab60724e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-934d0559-cecd-4f7d-a1de-53656026b19b tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:35 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 1073741824" returned: 0 in 0.932s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:35 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 Sep 29 12:46:35 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:36 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739" returned: 0 in 0.555s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.749s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062725092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b822eb8-392c-4b74-8e64-9eafbaec27c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:33Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume 9b822eb8-392c-4b74-8e64-9eafbaec27c6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:36 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 1073741824 Sep 29 12:46:36 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Flow 'volume_create_manager' (38c47d7c-e6d8-42d2-8fd1-e498fb320579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669aa6d2-fcec-4aa7-ae1f-0f50e30be17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa08ee1b-63a5-432f-92a7-c9b8750cb21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9836fcd-bc7a-471c-86dd-3d6165541739', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a064f5e-6761-439a-b009-15e9bcdeefa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669aa6d2-fcec-4aa7-ae1f-0f50e30be17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2041561950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c89e6e-c179-4e2e-bdf7-425cb96ef349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00b67fdf98b4bf8963aaca37a175835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:36Z,use_quota=True,user_id='d73c5ea1365d4b6b9fc31883499d41db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654f689c-0366-42b1-a273-8ceb32df1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654f689c-0366-42b1-a273-8ceb32df1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434303a8-1988-4573-a27a-83e3376ba5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434303a8-1988-4573-a27a-83e3376ba5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c89e6e-c179-4e2e-bdf7-425cb96ef349', 'volume_name': 'volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34a88ef-212f-4920-81a5-1cb7b49626e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34a88ef-212f-4920-81a5-1cb7b49626e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81016250-5e72-418e-b9da-13cc11898b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Volume 08c89e6e-c179-4e2e-bdf7-425cb96ef349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349', 'volume_size': 1} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-a9836fcd-bc7a-471c-86dd-3d6165541739 (a9836fcd-bc7a-471c-86dd-3d6165541739): created successfully Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a064f5e-6761-439a-b009-15e9bcdeefa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (3bd49215-5b28-4e35-b658-98cc314cf6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-71968b29-898f-4775-8574-6f9dfb0d0608 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:36 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 1073741824" returned: 0 in 0.533s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:36 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 Sep 29 12:46:36 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Flow 'volume_create_manager' (bd6f25ff-ee49-4498-aebf-dc03db5bdd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934af71-dc76-4d19-9244-55e43c46ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934af71-dc76-4d19-9244-55e43c46ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e506d553-3943-49a3-93d0-af763aea4911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92514a939e1844b5a23d39279f58ecc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:37Z,use_quota=True,user_id='2a1b3b4872c5490fb217703aff920faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a11446-d68e-4e99-a444-f95700eb8e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a11446-d68e-4e99-a444-f95700eb8e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a13672-dab1-49b8-a938-753bb6952c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:46:37 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6" returned: 0 in 0.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276487744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3449af-55ef-4c92-8f58-7d8fa0169736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b1f57d837b43aba0620107c147eacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:34Z,use_quota=True,user_id='c854d37e1e7b496bb17e15b8397a32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Creating volume 7c3449af-55ef-4c92-8f58-7d8fa0169736 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:37 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405ec7c9-9b87-4445-9397-fa07a75b8064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f1ab28-b4e0-4343-aef0-f4bbdc331f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 1073741824 Sep 29 12:46:37 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 (9b822eb8-392c-4b74-8e64-9eafbaec27c6): created successfully Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f1ab28-b4e0-4343-aef0-f4bbdc331f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (24f18031-ad4e-49a7-b3ca-cc5908c9159c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-98fe485d-945d-4ee8-be8f-b1b988188736 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a13672-dab1-49b8-a938-753bb6952c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e506d553-3943-49a3-93d0-af763aea4911', 'volume_name': 'volume-e506d553-3943-49a3-93d0-af763aea4911', 'volume_size': 1, 'image_id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1342b3e22da6a39b075ae7b80b52be75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92514a939e1844b5a23d39279f58ecc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ccd25995be7bb3e728bb989f225bf4788085a2ea4ff791de77e61642e5bb6ff90cf6e16036141cb6a4004383a3b99abfdd6316a5c9c00296e88f68d2e7fc6bc2', 'id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'created_at': datetime.datetime(2026, 9, 29, 10, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c813e15-597a-4f14-b183-4d231bcbe2d5/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fde1bc-9061-423e-9309-602022725d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fde1bc-9061-423e-9309-602022725d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bcb74d-e75b-49ad-85bf-c69ade3c5c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Volume e506d553-3943-49a3-93d0-af763aea4911: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e506d553-3943-49a3-93d0-af763aea4911', 'volume_size': 1, 'image_id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1342b3e22da6a39b075ae7b80b52be75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92514a939e1844b5a23d39279f58ecc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ccd25995be7bb3e728bb989f225bf4788085a2ea4ff791de77e61642e5bb6ff90cf6e16036141cb6a4004383a3b99abfdd6316a5c9c00296e88f68d2e7fc6bc2', 'id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'created_at': datetime.datetime(2026, 9, 29, 10, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c813e15-597a-4f14-b183-4d231bcbe2d5/file', 'properties': {}}, 'image_service': } Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Trying to clone e506d553-3943-49a3-93d0-af763aea4911 from image 9c813e15-597a-4f14-b183-4d231bcbe2d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:46:37 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103f519-6f75-49c4-800d-ca11c70822c5]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:37 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 1073741824" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:37 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 Sep 29 12:46:37 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:37 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:37 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:38 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736" returned: 0 in 0.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:38 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2041561950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c89e6e-c179-4e2e-bdf7-425cb96ef349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00b67fdf98b4bf8963aaca37a175835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:36Z,use_quota=True,user_id='d73c5ea1365d4b6b9fc31883499d41db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Creating volume 08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:38 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 1073741824 Sep 29 12:46:38 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e52214-0ba2-46da-9598-a522c45f118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3449af-55ef-4c92-8f58-7d8fa0169736', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddaa644-f76f-4077-83d7-2ae73b05fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Volume volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 (7c3449af-55ef-4c92-8f58-7d8fa0169736): created successfully Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddaa644-f76f-4077-83d7-2ae73b05fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Flow 'volume_create_manager' (1a8185dc-c6e4-4a72-b6e3-d7a69284cccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-50d01c63-32dc-429b-ae4e-fc4fa76b221d tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created volume successfully. Sep 29 12:46:38 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:38 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-7c3449af-55ef-4c92-8f58-7d8fa0169736-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-7c3449af-55ef-4c92-8f58-7d8fa0169736-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-7c3449af-55ef-4c92-8f58-7d8fa0169736" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-7c3449af-55ef-4c92-8f58-7d8fa0169736" acquired by "delete_volume" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:38 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Temporary image 9c813e15-597a-4f14-b183-4d231bcbe2d5 is fetched for user 2a1b3b4872c5490fb217703aff920faa. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d4d43-1487-4d19-96a6-ce68ad342e71]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:38 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 1073741824" returned: 0 in 0.775s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e6564-2618-46bc-8fed-ef7009986634]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:46:39 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:39 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 Sep 29 12:46:39 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:39 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:39 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:39 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736" returned: 0 in 0.482s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81016250-5e72-418e-b9da-13cc11898b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:39 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736 Sep 29 12:46:39 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025aa55d-747b-44a0-a7ae-bbf5f5d001e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Volume volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 (08c89e6e-c179-4e2e-bdf7-425cb96ef349): created successfully Sep 29 12:46:39 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025aa55d-747b-44a0-a7ae-bbf5f5d001e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Flow 'volume_create_manager' (38c47d7c-e6d8-42d2-8fd1-e498fb320579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3d3fd1f5-81b0-4f59-9b51-5e032ab2af4b tempest-VolumeDependencyTests-24626797 None] Created volume successfully. Sep 29 12:46:39 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:39 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:39 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7c3449af-55ef-4c92-8f58-7d8fa0169736" returned: 0 in 0.309s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-7c3449af-55ef-4c92-8f58-7d8fa0169736" released by "delete_volume" :: held 0.851s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['6136dba6-74b0-4f6a-b455-eb67ad4feb39', 'eef1e907-eace-4aee-9c3b-d60cd47420c6', '23f15a59-3e71-4fab-901a-8905cb53bc0a', 'ea33e119-5083-485c-a3fc-4fd1f35239fb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:39 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e506d553-3943-49a3-93d0-af763aea4911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92514a939e1844b5a23d39279f58ecc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:37Z,use_quota=True,user_id='2a1b3b4872c5490fb217703aff920faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Creating volume e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:39 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1073741824 Sep 29 12:46:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:39 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:40 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:40 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-9b822eb8-392c-4b74-8e64-9eafbaec27c6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-9b822eb8-392c-4b74-8e64-9eafbaec27c6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-9b822eb8-392c-4b74-8e64-9eafbaec27c6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-9b822eb8-392c-4b74-8e64-9eafbaec27c6" acquired by "delete_volume" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acdd7b1-ce36-4274-be88-95c51837fd63]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:40 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.480s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:40 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 Sep 29 12:46:40 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a14e541-68df-4bab-a96b-9ad9bd0d7aef tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-7c3449af-55ef-4c92-8f58-7d8fa0169736-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:40 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1073741824" returned: 0 in 0.824s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:40 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 Sep 29 12:46:40 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:40 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6" returned: 0 in 0.637s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:40 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6 Sep 29 12:46:40 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:41 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.296s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Creating offline snapshot a520d07c-d4ec-4024-ad86-2fd6fdbb18fb of volume 08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Attempting download of 9c813e15-597a-4f14-b183-4d231bcbe2d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}])) to volume e506d553-3943-49a3-93d0-af763aea4911. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c4c0a-d3ee-4c4e-9710-17bd0fcf8477]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:41 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9b822eb8-392c-4b74-8e64-9eafbaec27c6" returned: 0 in 0.399s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c7652-0cca-4d52-8de2-0b3b528d2da4]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:41 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:46:41 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-9b822eb8-392c-4b74-8e64-9eafbaec27c6" released by "delete_volume" :: held 1.138s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['a4970be8-e074-43ec-aef7-2a47d6873518', 'fc051ded-08c8-4bd0-bfa8-24bd06ed7d87', '797c7c18-635c-41f5-b588-21136929b9d0', '497aff9e-1709-4481-9971-e9b1004122cb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:41 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6 Sep 29 12:46:41 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:41 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:41 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:41 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.493s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:41 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb 1G Sep 29 12:46:41 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:41 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6" returned: 0 in 0.516s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:41 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad2b23e-0384-4962-8a1a-f25894580fa5 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-9b822eb8-392c-4b74-8e64-9eafbaec27c6-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:42 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6 Sep 29 12:46:42 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb 1G" returned: 0 in 0.529s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:42 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:42 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6" returned: 1 in 0.405s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c813e15-597a-4f14-b183-4d231bcbe2d5__xzcpmm6' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9a193-0e22-471c-aaa7-d91463e740bb]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:42 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:42 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-a9836fcd-bc7a-471c-86dd-3d6165541739-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-a9836fcd-bc7a-471c-86dd-3d6165541739-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:42 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.393s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb is being set with open permissions: ugo+rw Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-a9836fcd-bc7a-471c-86dd-3d6165541739" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:42 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:42 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-a9836fcd-bc7a-471c-86dd-3d6165541739" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704bd99-a137-4086-a392-c420481876ce]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:42 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:42 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD Sep 29 12:46:42 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 Sep 29 12:46:42 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:42 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.354s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info Sep 29 12:46:43 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] 9c813e15-597a-4f14-b183-4d231bcbe2d5 was raw, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 Sep 29 12:46:43 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739 Sep 29 12:46:43 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info is being set with open permissions: ugo+rw Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info Sep 29 12:46:43 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9836fcd-bc7a-471c-86dd-3d6165541739" returned: 0 in 0.350s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-a9836fcd-bc7a-471c-86dd-3d6165541739" released by "delete_volume" :: held 0.896s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['a7258257-2ea8-4052-a5a6-28b52a828c31', '56de7916-6942-49fa-80ec-95f72868ac4b', '995920f9-6180-4804-89ed-e6b07fbad42c', 'e18f0540-483f-42d7-9dcf-bb4e4584fe53'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:43 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.info" returned: 0 in 0.359s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911" returned: 0 in 0.659s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c813e15-597a-4f14-b183-4d231bcbe2d5_4wrmq4ctdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:46:43 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:43 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1G Sep 29 12:46:43 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-a9a6868c-71c5-4e50-a3ad-53dfbce4f138-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5b7d3c77-5867-4986-824e-ea86131ae075 tempest-VolumeDependencyTests-24626797 None] Create snapshot completed successfully Sep 29 12:46:43 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:43 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-a9a6868c-71c5-4e50-a3ad-53dfbce4f138-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[509780b7-56b9-454f-9d24-35912a2c0265]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:44 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 Sep 29 12:46:44 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:44 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 1G" returned: 0 in 0.568s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:44 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Downloaded image 9c813e15-597a-4f14-b183-4d231bcbe2d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}])) to volume e506d553-3943-49a3-93d0-af763aea4911 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Temporary image 9c813e15-597a-4f14-b183-4d231bcbe2d5 for user 2a1b3b4872c5490fb217703aff920faa is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Marking volume e506d553-3943-49a3-93d0-af763aea4911 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Copying metadata from image 9c813e15-597a-4f14-b183-4d231bcbe2d5 to e506d553-3943-49a3-93d0-af763aea4911. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Creating volume glance metadata for volume e506d553-3943-49a3-93d0-af763aea4911 backed by image 9c813e15-597a-4f14-b183-4d231bcbe2d5 with: {'image_id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1342b3e22da6a39b075ae7b80b52be75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c48bb00e-c56e-45e1-aea2-c72d72c38394 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-a9836fcd-bc7a-471c-86dd-3d6165541739-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bcb74d-e75b-49ad-85bf-c69ade3c5c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e506d553-3943-49a3-93d0-af763aea4911', 'volume_size': 1, 'image_id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c813e15-597a-4f14-b183-4d231bcbe2d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1342b3e22da6a39b075ae7b80b52be75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92514a939e1844b5a23d39279f58ecc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ccd25995be7bb3e728bb989f225bf4788085a2ea4ff791de77e61642e5bb6ff90cf6e16036141cb6a4004383a3b99abfdd6316a5c9c00296e88f68d2e7fc6bc2', 'id': '9c813e15-597a-4f14-b183-4d231bcbe2d5', 'created_at': datetime.datetime(2026, 9, 29, 10, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c813e15-597a-4f14-b183-4d231bcbe2d5/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4cd770-3a7c-4300-8af3-32c19aa7d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Volume volume-e506d553-3943-49a3-93d0-af763aea4911 (e506d553-3943-49a3-93d0-af763aea4911): created successfully Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4cd770-3a7c-4300-8af3-32c19aa7d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Flow 'volume_create_manager' (bd6f25ff-ee49-4498-aebf-dc03db5bdd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-44b0432e-e1a4-4b73-9c0d-97cd9fb87954 tempest-VolumeImageDependencyTests-1643694328 None] Created volume successfully. Sep 29 12:46:44 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" returned: 0 in 0.666s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:44 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138 Sep 29 12:46:44 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Flow 'volume_create_manager' (5ff36f5e-534b-47e7-8133-65f79992006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba47ef-a7f6-4ba0-9abc-153eae23483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba47ef-a7f6-4ba0-9abc-153eae23483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2113161200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce0c693-8a54-4185-96b6-337c658cb190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00b67fdf98b4bf8963aaca37a175835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a520d07c-d4ec-4024-ad86-2fd6fdbb18fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:45Z,use_quota=True,user_id='d73c5ea1365d4b6b9fc31883499d41db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68354885-c816-44ec-b523-82e5165f2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68354885-c816-44ec-b523-82e5165f2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac6894e-6d16-436d-b718-bcb78844d72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac6894e-6d16-436d-b718-bcb78844d72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ce0c693-8a54-4185-96b6-337c658cb190', 'volume_name': 'volume-2ce0c693-8a54-4185-96b6-337c658cb190', 'volume_size': 1, 'snapshot_id': 'a520d07c-d4ec-4024-ad86-2fd6fdbb18fb'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a1c297-a3ff-4ed9-b92d-23fa35f11f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a1c297-a3ff-4ed9-b92d-23fa35f11f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0feea855-c32f-4a09-97cc-a036e28b2fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Volume 2ce0c693-8a54-4185-96b6-337c658cb190: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ce0c693-8a54-4185-96b6-337c658cb190', 'volume_size': 1, 'snapshot_id': 'a520d07c-d4ec-4024-ad86-2fd6fdbb18fb'} Sep 29 12:46:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-2ce0c693-8a54-4185-96b6-337c658cb190" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-a9a6868c-71c5-4e50-a3ad-53dfbce4f138" released by "delete_volume" :: held 1.023s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-2ce0c693-8a54-4185-96b6-337c658cb190" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Creating volume 2ce0c693-8a54-4185-96b6-337c658cb190 from snapshot a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] snapshot: a520d07c-d4ec-4024-ad86-2fd6fdbb18fb, volume: 2ce0c693-8a54-4185-96b6-337c658cb190, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['e679bfa3-dd5d-4973-a33c-106026745021', '688c1505-1d3b-415d-ba73-37a331727195', 'f909bfdd-7461-41c3-be44-886a985a637c', '84e13e43-cfa5-4ae4-b727-363ad269cc94'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1dfa8e-6bab-4c66-a0c8-02996cf5bd7d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:45 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:45 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:45 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:45 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:45 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6b028f4-d307-4b9b-a890-f3e2f5bafa89 tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-a9a6868c-71c5-4e50-a3ad-53dfbce4f138-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:45 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.407s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eb6f61-762d-4655-b74a-daa2325f0f2b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:45 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:46:45 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Acquiring lock "cinder-e506d553-3943-49a3-93d0-af763aea4911-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "cinder-e506d553-3943-49a3-93d0-af763aea4911-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Acquiring lock "cinder-quobyte-e506d553-3943-49a3-93d0-af763aea4911" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "cinder-quobyte-e506d553-3943-49a3-93d0-af763aea4911" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[440aae58-6603-4c24-b236-fd590475ac2c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:45 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:46:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:45 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 Sep 29 12:46:45 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:46 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 Sep 29 12:46:46 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-441adbeb-824f-41db-b722-80be159ae6a7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-441adbeb-824f-41db-b722-80be159ae6a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-441adbeb-824f-41db-b722-80be159ae6a7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-441adbeb-824f-41db-b722-80be159ae6a7" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb2164-1e6b-4132-900a-2defe3ee25df]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:46 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911" returned: 0 in 0.460s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:46 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 Sep 29 12:46:46 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:46 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911 Sep 29 12:46:46 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:46 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e506d553-3943-49a3-93d0-af763aea4911" returned: 0 in 0.378s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "cinder-quobyte-e506d553-3943-49a3-93d0-af763aea4911" released by "delete_volume" :: held 0.896s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:46 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7" returned: 0 in 0.607s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=134,cinder:UPDATE=140,cinder:DELETE=18,cinder:INSERT=34 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Created reservations ['3710b60e-ff26-4938-b121-e2207215097e', '2381e0ec-8cb2-44cf-a39a-894f52d92051', 'c04ca604-f2dd-4781-8bb0-b4fb6b803440', '70c08500-17da-4206-b861-401bc3ee37d8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:47 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7 Sep 29 12:46:47 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:47 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:47 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:47 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.486s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Deleted volume successfully. Sep 29 12:46:47 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=150,cinder:UPDATE=196,cinder:INSERT=51,cinder:DELETE=12 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-441adbeb-824f-41db-b722-80be159ae6a7" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-441adbeb-824f-41db-b722-80be159ae6a7" released by "delete_volume" :: held 1.562s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-edb8ed21-aa30-4689-b875-54a09c86819e tempest-VolumeImageDependencyTests-1643694328 None] Lock "cinder-e506d553-3943-49a3-93d0-af763aea4911-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:47 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['357a612f-64cf-407a-815a-ee85eb35bb7d', '5848ed7a-6947-4868-b6b1-4d71bd9d940c', '76a8ffcd-0e0c-4178-a2f8-9aff45b805ab', 'c5b583fc-dce5-48d8-94eb-b5740b05e3e0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:48 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:48 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:48 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.493s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-93c8f5fe-9f50-47c5-8137-7df39c8769b6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-93c8f5fe-9f50-47c5-8137-7df39c8769b6-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aa8bce94-236a-41c6-a764-f47494cba8de tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-441adbeb-824f-41db-b722-80be159ae6a7-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "cinder-quobyte-93c8f5fe-9f50-47c5-8137-7df39c8769b6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-93c8f5fe-9f50-47c5-8137-7df39c8769b6" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9871b9d-e272-48f3-8e29-a50b2d2c82df]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:49 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 Sep 29 12:46:49 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:50 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6" returned: 0 in 1.299s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:50 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6 Sep 29 12:46:50 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:51 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-93c8f5fe-9f50-47c5-8137-7df39c8769b6" returned: 0 in 0.718s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-quobyte-93c8f5fe-9f50-47c5-8137-7df39c8769b6" released by "delete_volume" :: held 2.192s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Created reservations ['4013ecec-7dcc-4bc8-8717-26f6c170ff4c', '603df9e9-f9ef-428f-abf1-f0e3e25ebd48', 'de0c882a-5056-4ede-a10a-0c8476d7f64e', 'e60b7779-eff1-4529-923a-8f7c2c575890'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:51 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:46:51 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:52 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.534s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:46:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Deleted volume successfully. Sep 29 12:46:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f9642dfa-17c3-41d1-b281-f5e652d2b33a tempest-CreateVolumesFromSourceVolumeTest-1199735908 None] Lock "cinder-93c8f5fe-9f50-47c5-8137-7df39c8769b6-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:56 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190" returned: 0 in 10.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349, size 1024.00 MB, duration 10.33 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:46:56 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Converted 1024.00 MB image at 99.08 MB/s Sep 29 12:46:56 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 is being set with open permissions: ugo+rw Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:56 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 Sep 29 12:46:56 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:56 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" released by "_copy_volume_from_snapshot" :: held 11.517s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-2ce0c693-8a54-4185-96b6-337c658cb190" released by "_create_volume_from_snapshot" :: held 11.585s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.617s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0feea855-c32f-4a09-97cc-a036e28b2fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce0c693-8a54-4185-96b6-337c658cb190', 'volume_size': 1, 'snapshot_id': 'a520d07c-d4ec-4024-ad86-2fd6fdbb18fb'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28efaee7-15e4-4b40-9765-166087e7f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Volume volume-2ce0c693-8a54-4185-96b6-337c658cb190 (2ce0c693-8a54-4185-96b6-337c658cb190): created successfully Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28efaee7-15e4-4b40-9765-166087e7f734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Flow 'volume_create_manager' (5ff36f5e-534b-47e7-8133-65f79992006d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6eb1eec-5b6f-44d2-94f3-0a21fb922a36 tempest-VolumeDependencyTests-24626797 None] Created volume successfully. Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Deleting offline snapshot a520d07c-d4ec-4024-ad86-2fd6fdbb18fb of volume 08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] snapshot_file for this snap is: volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7a73f-a85b-4360-b597-cdc1ee60fce3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:57 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:57 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Flow 'volume_create_manager' (7cc136bc-ecc8-47e2-890d-6b041935871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706b3dcb-129f-41a8-b6fd-fe2ff8f6eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706b3dcb-129f-41a8-b6fd-fe2ff8f6eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284c8b28-76b8-4e8c-a1cb-aa237b768379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300064c046cf477e81d6a23c139da11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:58Z,use_quota=True,user_id='be7de79e5a7e44a788415b60fc949476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8da8f-1111-4de9-a01a-83bc5991fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8da8f-1111-4de9-a01a-83bc5991fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fba9be-e1f0-487e-8ee3-a4980096d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fba9be-e1f0-487e-8ee3-a4980096d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284c8b28-76b8-4e8c-a1cb-aa237b768379', 'volume_name': 'volume-284c8b28-76b8-4e8c-a1cb-aa237b768379', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f646a9-6e0e-443a-b9b8-13aaad23d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f646a9-6e0e-443a-b9b8-13aaad23d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fa0154-5d38-4523-9a7e-e05d7a8c1b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Volume 284c8b28-76b8-4e8c-a1cb-aa237b768379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284c8b28-76b8-4e8c-a1cb-aa237b768379', 'volume_size': 1} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284c8b28-76b8-4e8c-a1cb-aa237b768379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300064c046cf477e81d6a23c139da11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:46:58Z,use_quota=True,user_id='be7de79e5a7e44a788415b60fc949476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Creating volume 284c8b28-76b8-4e8c-a1cb-aa237b768379 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:46:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:57 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 1073741824 Sep 29 12:46:57 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:57 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca0ff99-77b0-4fa2-b5f5-38eefb15b351]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:58 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:46:58 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:58 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 1073741824" returned: 0 in 0.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:58 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 Sep 29 12:46:58 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:58 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.582s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:58 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379" returned: 0 in 0.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:46:58 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:58 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fa0154-5d38-4523-9a7e-e05d7a8c1b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284c8b28-76b8-4e8c-a1cb-aa237b768379', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa1b8a-0b76-4394-8563-0862165ee53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:46:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Volume volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 (284c8b28-76b8-4e8c-a1cb-aa237b768379): created successfully Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa1b8a-0b76-4394-8563-0862165ee53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Flow 'volume_create_manager' (7cc136bc-ecc8-47e2-890d-6b041935871b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:46:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5913fecb-f896-42aa-8f6d-09288782a0dd tempest-CinderUnicodeTest-510476739 None] Created volume successfully. Sep 29 12:46:58 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:58 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb Sep 29 12:46:58 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:46:59 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349.a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb" released by "_delete_snapshot" :: held 1.705s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" released by "delete_snapshot" :: held 1.734s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Created reservations ['8ad61027-7501-49aa-ac18-4e0256e74160', '0406f9c5-4911-458d-a940-30e9486b3ca0', 'bfaf0b0e-6231-4dfc-8738-11da95094f45', 'c5c97694-bb80-46cb-8f90-9e35c872e971'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:46:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Delete snapshot completed successfully. Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c267058c-3c9f-441a-b14d-5672326b7d6c tempest-VolumeDependencyTests-24626797 None] Lock "cinder-a520d07c-d4ec-4024-ad86-2fd6fdbb18fb-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-08c89e6e-c179-4e2e-bdf7-425cb96ef349-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-08c89e6e-c179-4e2e-bdf7-425cb96ef349-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0c670-c664-4bf5-bd45-aa999d082b41]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:46:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:46:59 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:46:59 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:00 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:00 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349 Sep 29 12:47:00 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Flow 'volume_create_manager' (d940ebc4-48a3-4d06-8353-652f933d52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6062a557-7455-4540-8cd7-8029c650e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6062a557-7455-4540-8cd7-8029c650e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1759540458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbae558f-bcc8-4ffa-be16-62c7d2b3322e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300064c046cf477e81d6a23c139da11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:00Z,use_quota=True,user_id='be7de79e5a7e44a788415b60fc949476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b2cf29-c27e-48dd-a7a3-32319458cf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b2cf29-c27e-48dd-a7a3-32319458cf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095eeb85-d262-4917-9d74-fbbde533580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095eeb85-d262-4917-9d74-fbbde533580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbae558f-bcc8-4ffa-be16-62c7d2b3322e', 'volume_name': 'volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7c60c-9b38-4344-8037-eccc6c293f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:00 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7c60c-9b38-4344-8037-eccc6c293f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d70fb-6337-4bf1-9243-74675f565bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Volume fbae558f-bcc8-4ffa-be16-62c7d2b3322e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e', 'volume_size': 1} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1759540458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbae558f-bcc8-4ffa-be16-62c7d2b3322e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300064c046cf477e81d6a23c139da11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:00Z,use_quota=True,user_id='be7de79e5a7e44a788415b60fc949476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Creating volume fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-08c89e6e-c179-4e2e-bdf7-425cb96ef349" returned: 0 in 0.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:00 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e 1073741824 Sep 29 12:47:00 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-08c89e6e-c179-4e2e-bdf7-425cb96ef349" released by "delete_volume" :: held 0.777s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Created reservations ['125b82bc-dbe6-4ff2-b0ba-b0d953d30e15', 'e121d999-e8f9-4836-b67d-7a436e24a02b', '82fe42ca-6963-4aac-9bc0-3cbc17c96033', '24f187f0-ecd4-4c36-b2cd-ab3f61d32bf3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:00 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:00 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-2ce0c693-8a54-4185-96b6-337c658cb190-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-2ce0c693-8a54-4185-96b6-337c658cb190-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:00 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.313s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Deleted volume successfully. Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[346bea86-60ab-4e1a-b0d6-f95222105719]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24820fe2-d9b5-4ded-b36d-53af762e6e98 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-08c89e6e-c179-4e2e-bdf7-425cb96ef349-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:00 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e 1073741824" returned: 0 in 0.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:01 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 Sep 29 12:47:01 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:01 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e Sep 29 12:47:01 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:01 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" returned: 0 in 0.290s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d70fb-6337-4bf1-9243-74675f565bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:01 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0387ca3-bc41-43e4-84e3-5601a791d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190" returned: 0 in 0.416s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Volume volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e (fbae558f-bcc8-4ffa-be16-62c7d2b3322e): created successfully Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0387ca3-bc41-43e4-84e3-5601a791d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Flow 'volume_create_manager' (d940ebc4-48a3-4d06-8353-652f933d52f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:01 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190 Sep 29 12:47:01 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2bcc71b8-9d21-4c9f-8687-d34cbb9af61a tempest-CinderUnicodeTest-510476739 None] Created volume successfully. Sep 29 12:47:01 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2ce0c693-8a54-4185-96b6-337c658cb190" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-quobyte-2ce0c693-8a54-4185-96b6-337c658cb190" released by "delete_volume" :: held 0.730s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Created reservations ['d79d0a33-b7ad-4517-b3dd-c0b61a2e495b', '19403811-6d67-4ed3-9c7b-2ade0a92cbdc', '13da1641-f156-4476-b981-37fa2d799dc0', '285e4c38-90aa-41a9-8638-64cc79639676'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:01 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:01 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:01 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Deleted volume successfully. Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65d54ece-e8b2-4ef5-873a-764ec93c79a7 tempest-VolumeDependencyTests-24626797 None] Lock "cinder-2ce0c693-8a54-4185-96b6-337c658cb190-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Creating offline snapshot 50b853fd-f449-415c-ad74-dbbd7a835bb7 of volume fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae06b2-f74d-4a0e-87a7-50119f9a31f7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:02 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e Sep 29 12:47:02 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:03 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" returned: 0 in 0.468s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:03 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 1G Sep 29 12:47:03 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:03 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 1G" returned: 0 in 0.534s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:03 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 Sep 29 12:47:03 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:04 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7" returned: 0 in 0.320s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:04 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 is being set with open permissions: ugo+rw Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:04 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 Sep 29 12:47:04 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:04 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7" returned: 0 in 0.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:04 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info Sep 29 12:47:04 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:04 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:04 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info is being set with open permissions: ugo+rw Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:04 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info Sep 29 12:47:04 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:04 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.info" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4a7039a9-122e-4ad5-9cdd-d8b40e08edd5 tempest-CinderUnicodeTest-510476739 None] Create snapshot completed successfully Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Flow 'volume_create_manager' (cfa384e0-b5e1-4782-88af-e23aa4e2499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c7272-fd62-4f79-a6a0-176b8982469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c7272-fd62-4f79-a6a0-176b8982469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284783662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b36797-5123-4c93-a8f9-5d4df23888ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf141ef067144e49c99c1e1f289075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:06Z,use_quota=True,user_id='af39ecb6bd664fa68f5756d82aebf695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc90dbe6-1f47-4348-89ab-41d73d4808b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc90dbe6-1f47-4348-89ab-41d73d4808b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dd645a-e743-4859-a0ab-afccf2ab51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dd645a-e743-4859-a0ab-afccf2ab51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b36797-5123-4c93-a8f9-5d4df23888ad', 'volume_name': 'volume-39b36797-5123-4c93-a8f9-5d4df23888ad', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1e53ec-6054-410a-bd28-53d2c226976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1e53ec-6054-410a-bd28-53d2c226976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7700b7dc-1f26-4a14-8b4b-ea5abe6db0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Volume 39b36797-5123-4c93-a8f9-5d4df23888ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b36797-5123-4c93-a8f9-5d4df23888ad', 'volume_size': 1} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284783662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b36797-5123-4c93-a8f9-5d4df23888ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf141ef067144e49c99c1e1f289075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:06Z,use_quota=True,user_id='af39ecb6bd664fa68f5756d82aebf695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Creating volume 39b36797-5123-4c93-a8f9-5d4df23888ad {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-50b853fd-f449-415c-ad74-dbbd7a835bb7-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:05 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad 1073741824 Sep 29 12:47:05 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-50b853fd-f449-415c-ad74-dbbd7a835bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-quobyte-50b853fd-f449-415c-ad74-dbbd7a835bb7" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-50b853fd-f449-415c-ad74-dbbd7a835bb7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Deleting offline snapshot 50b853fd-f449-415c-ad74-dbbd7a835bb7 of volume fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] snapshot_file for this snap is: volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ec4fe-35b1-4dc2-952e-de4f2fbf80fd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:06 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 Sep 29 12:47:06 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:06 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad 1073741824" returned: 0 in 0.466s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:06 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:47:06 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad Sep 29 12:47:06 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614930e-6e0c-4601-9064-70acc7773504]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:06 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e Sep 29 12:47:06 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:06 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7700b7dc-1f26-4a14-8b4b-ea5abe6db0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b36797-5123-4c93-a8f9-5d4df23888ad', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d532be-e376-44e8-9a8f-9ad4502b3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Volume volume-39b36797-5123-4c93-a8f9-5d4df23888ad (39b36797-5123-4c93-a8f9-5d4df23888ad): created successfully Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d532be-e376-44e8-9a8f-9ad4502b3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Flow 'volume_create_manager' (cfa384e0-b5e1-4782-88af-e23aa4e2499d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e72d1440-66f5-4697-8373-0fe682fd7333 tempest-ProjectReaderTests-1030476770 None] Created volume successfully. Sep 29 12:47:06 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:06 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 Sep 29 12:47:06 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "cinder-39b36797-5123-4c93-a8f9-5d4df23888ad-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-39b36797-5123-4c93-a8f9-5d4df23888ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "cinder-quobyte-39b36797-5123-4c93-a8f9-5d4df23888ad" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-quobyte-39b36797-5123-4c93-a8f9-5d4df23888ad" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7179a4f0-8ba1-4be1-a243-5c75906414df]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:07 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7" returned: 0 in 0.387s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:07 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad Sep 29 12:47:07 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:07 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7 Sep 29 12:47:07 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:07 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e.50b853fd-f449-415c-ad74-dbbd7a835bb7" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:07 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad" returned: 0 in 0.406s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-50b853fd-f449-415c-ad74-dbbd7a835bb7" released by "_delete_snapshot" :: held 1.587s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" released by "delete_snapshot" :: held 1.614s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:07 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad Sep 29 12:47:07 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Created reservations ['4db0af4a-e085-4331-92e3-53760b32b918', '884a47d4-e3b5-4a9e-8c1c-bcd6f282538b', '205fc4ba-6d1e-4bf2-8f78-61fd884aba93', 'fdd26ddd-5edf-417b-9ead-e3348f2a698e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Delete snapshot completed successfully. Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13d09ecd-5a79-42a2-b0cb-79caf3657caf tempest-CinderUnicodeTest-510476739 None] Lock "cinder-50b853fd-f449-415c-ad74-dbbd7a835bb7-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:07 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39b36797-5123-4c93-a8f9-5d4df23888ad" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-quobyte-39b36797-5123-4c93-a8f9-5d4df23888ad" released by "delete_volume" :: held 0.699s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Created reservations ['427198cf-390d-4088-aa4b-4aa5ac2b4d03', 'd80bdbc4-1d8d-4b7e-a12f-fdc8127b066e', 'a01775d0-f22f-4cc1-8629-effdb83236c7', '83219137-20df-4280-976a-5f88d13afa0e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:07 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:07 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-fbae558f-bcc8-4ffa-be16-62c7d2b3322e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "cinder-fbae558f-bcc8-4ffa-be16-62c7d2b3322e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:08 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Deleted volume successfully. Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ad8c9-1539-4a6d-b2a1-948436c1beed]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1359744-6789-4bab-86bc-212474758f30 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-39b36797-5123-4c93-a8f9-5d4df23888ad-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:08 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e Sep 29 12:47:08 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:08 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:08 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e Sep 29 12:47:08 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Flow 'volume_create_manager' (a79e36ba-26bb-48f1-8407-4ee8b0191c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097575a3-b36c-4bd7-b2ea-70b679deee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097575a3-b36c-4bd7-b2ea-70b679deee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470024419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffc3537-b055-46c2-87bc-d72d37369846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf141ef067144e49c99c1e1f289075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:09Z,use_quota=True,user_id='af39ecb6bd664fa68f5756d82aebf695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea479757-70f6-4e83-b504-c8fb9a5f60a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea479757-70f6-4e83-b504-c8fb9a5f60a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f6d185-9009-47ae-a032-d57a4c655960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f6d185-9009-47ae-a032-d57a4c655960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffc3537-b055-46c2-87bc-d72d37369846', 'volume_name': 'volume-cffc3537-b055-46c2-87bc-d72d37369846', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0d2fa-2e78-44b4-9ded-6a999abdced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0d2fa-2e78-44b4-9ded-6a999abdced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dfc216-faf5-47c2-9c80-41e9c061d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Volume cffc3537-b055-46c2-87bc-d72d37369846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffc3537-b055-46c2-87bc-d72d37369846', 'volume_size': 1} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470024419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffc3537-b055-46c2-87bc-d72d37369846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf141ef067144e49c99c1e1f289075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:09Z,use_quota=True,user_id='af39ecb6bd664fa68f5756d82aebf695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Creating volume cffc3537-b055-46c2-87bc-d72d37369846 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:08 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:08 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 1073741824 Sep 29 12:47:08 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:08 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-fbae558f-bcc8-4ffa-be16-62c7d2b3322e" released by "delete_volume" :: held 0.756s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Created reservations ['072961fd-22b7-417d-8812-ef7281f01dfd', '5952bc8a-8ff6-4758-b1fa-d8055833913e', '7ed585af-6ce9-4b50-a2d3-82b362495239', 'ce8ef802-b873-499a-8c03-a9c736807a1f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:09 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:09 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-284c8b28-76b8-4e8c-a1cb-aa237b768379-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "cinder-284c8b28-76b8-4e8c-a1cb-aa237b768379-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:09 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Acquiring lock "cinder-quobyte-284c8b28-76b8-4e8c-a1cb-aa237b768379" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Deleted volume successfully. Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-284c8b28-76b8-4e8c-a1cb-aa237b768379" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4c959495-d326-48bd-b4a2-09533a4ba4bd tempest-CinderUnicodeTest-510476739 None] Lock "cinder-fbae558f-bcc8-4ffa-be16-62c7d2b3322e-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000d082-8ef5-4333-8b19-38b2a895e8a2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:09 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 1073741824" returned: 0 in 0.594s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:09 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 Sep 29 12:47:09 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:09 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 Sep 29 12:47:09 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:09 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dfc216-faf5-47c2-9c80-41e9c061d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffc3537-b055-46c2-87bc-d72d37369846', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d06f394-c37b-4117-adfe-d2627fd1db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Volume volume-cffc3537-b055-46c2-87bc-d72d37369846 (cffc3537-b055-46c2-87bc-d72d37369846): created successfully Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d06f394-c37b-4117-adfe-d2627fd1db26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Flow 'volume_create_manager' (a79e36ba-26bb-48f1-8407-4ee8b0191c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-85a38849-5790-4a67-bfd6-6c1996d5c57c tempest-ProjectReaderTests-1030476770 None] Created volume successfully. Sep 29 12:47:09 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379" returned: 0 in 0.425s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:09 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379 Sep 29 12:47:09 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:10 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-284c8b28-76b8-4e8c-a1cb-aa237b768379" returned: 0 in 0.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "cinder-quobyte-284c8b28-76b8-4e8c-a1cb-aa237b768379" released by "delete_volume" :: held 0.723s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Created reservations ['7353ed19-841c-4c06-a0f8-0a519da3d778', '03b2b9ba-0faa-4a33-9711-f4b8d5be2ddb', '61957e05-08a8-46b2-b957-e4ba55f971c2', 'a0838bc2-2e02-4ff3-891e-fa999b630c3b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:10 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:10 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:10 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Deleted volume successfully. Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e82af422-57f3-4c3c-bc0e-2b90806e1b63 tempest-CinderUnicodeTest-510476739 None] Lock "cinder-284c8b28-76b8-4e8c-a1cb-aa237b768379-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "cinder-cffc3537-b055-46c2-87bc-d72d37369846-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-cffc3537-b055-46c2-87bc-d72d37369846-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "cinder-quobyte-cffc3537-b055-46c2-87bc-d72d37369846" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-quobyte-cffc3537-b055-46c2-87bc-d72d37369846" acquired by "delete_volume" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7842f6-7131-4126-9bdc-43c7077adb28]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:11 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 Sep 29 12:47:11 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:11 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846" returned: 0 in 0.418s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:11 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846 Sep 29 12:47:11 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:11 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cffc3537-b055-46c2-87bc-d72d37369846" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-quobyte-cffc3537-b055-46c2-87bc-d72d37369846" released by "delete_volume" :: held 0.730s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Created reservations ['8e21cb69-f9c9-41b3-b6f7-7fc8e5fdaf67', '580013a2-0ad5-488c-bdbd-b2cc7b546ea5', 'f8211634-2114-4074-987d-3ae6143dbfa1', 'cf88be70-0b55-47a8-a698-64440b8de1ad'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:11 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:11 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:12 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Deleted volume successfully. Sep 29 12:47:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7dfa750c-96a4-429a-b9cf-024b0e391c36 tempest-ProjectReaderTests-1030476770 None] Lock "cinder-cffc3537-b055-46c2-87bc-d72d37369846-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:16 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (30763812-dc75-489e-b636-bba7068df050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5fbad2-34d5-4ee9-8c97-c0bce5d5528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5fbad2-34d5-4ee9-8c97-c0bce5d5528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691034219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9e0e39-6590-43f3-acfb-0d6f8e32199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:17Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861ffeb6-d666-44e4-991b-395c1a76971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861ffeb6-d666-44e4-991b-395c1a76971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a42a78-a9c3-4927-a15d-716638dbd5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a42a78-a9c3-4927-a15d-716638dbd5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9e0e39-6590-43f3-acfb-0d6f8e32199e', 'volume_name': 'volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fa3284-f4bf-48fa-aea2-9c559754dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fa3284-f4bf-48fa-aea2-9c559754dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf53d6b-c157-473e-83f3-e4851c393197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Volume 2c9e0e39-6590-43f3-acfb-0d6f8e32199e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e', 'volume_size': 1} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691034219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9e0e39-6590-43f3-acfb-0d6f8e32199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:17Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Creating volume 2c9e0e39-6590-43f3-acfb-0d6f8e32199e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:17 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e 1073741824 Sep 29 12:47:17 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:17 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e 1073741824" returned: 0 in 0.629s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:17 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e Sep 29 12:47:17 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:18 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" returned: 0 in 0.435s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf53d6b-c157-473e-83f3-e4851c393197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56703c91-31a5-49c2-9b16-ef1d9088e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Volume volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e (2c9e0e39-6590-43f3-acfb-0d6f8e32199e): created successfully Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56703c91-31a5-49c2-9b16-ef1d9088e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (30763812-dc75-489e-b636-bba7068df050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e376e0e2-1208-4d93-a1a4-48d49357a9b4 tempest-ProjectReaderTests-1962924705 None] Created volume successfully. Sep 29 12:47:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-2b646970-ba34-4af2-a54e-e679b8dc157c tempest-TestShelveInstance-1778842090 None] Terminate volume connection completed successfully. Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-2b646970-ba34-4af2-a54e-e679b8dc157c tempest-TestShelveInstance-1778842090 None] Deleting attachment fa5d4ba2-0ec8-4529-a0d8-3de986532c19. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Acquiring lock "cinder-3a0d13f0-9a35-430c-825b-a48f3bcde8d7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "cinder-3a0d13f0-9a35-430c-825b-a48f3bcde8d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Acquiring lock "cinder-quobyte-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "cinder-quobyte-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f1ef23-bd93-4195-96de-0082f3a712b1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:18 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 Sep 29 12:47:18 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:19 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" returned: 0 in 0.500s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:19 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7 Sep 29 12:47:19 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-2c9e0e39-6590-43f3-acfb-0d6f8e32199e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "cinder-2c9e0e39-6590-43f3-acfb-0d6f8e32199e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-quobyte-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:19 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" returned: 0 in 0.417s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "cinder-quobyte-3a0d13f0-9a35-430c-825b-a48f3bcde8d7" released by "delete_volume" :: held 0.974s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb6548-2bec-4dc9-b048-ba2d57fb17ce]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.quota [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Created reservations ['87637bbb-5f34-4076-b4b4-e9dcf4f31568', '3cc47615-76bd-4725-99c7-366212818b90', 'e5a61035-90a5-4016-8f90-a445dc63d62a', '6ecd437d-78d8-4b3a-ab72-18a69249221c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:19 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e Sep 29 12:47:19 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:19 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:19 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:20 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" returned: 0 in 0.522s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:20 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:20 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.manager [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:20 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Deleted volume successfully. Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-cd28c2fa-61b5-488a-b296-92237d2cc11f req-6b05e7d1-0e30-4a54-9d8a-c2d4d3de743b tempest-TestShelveInstance-1778842090 None] Lock "cinder-3a0d13f0-9a35-430c-825b-a48f3bcde8d7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:20 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" returned: 0 in 0.376s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-2c9e0e39-6590-43f3-acfb-0d6f8e32199e" released by "delete_volume" :: held 0.965s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Created reservations ['a05edf4d-93a8-4483-9848-0ee50063a6bf', '21e078b5-7548-4938-a2ba-c0059e0bc33c', '136b73ab-94e0-4383-8d1f-077c3055d3db', '7192d991-862b-4a4a-b909-bb89099f577f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:20 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:20 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:20 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:20 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Deleted volume successfully. Sep 29 12:47:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a30a9d09-b34b-4b15-b856-1f260ba3babc tempest-ProjectReaderTests-1962924705 None] Lock "cinder-2c9e0e39-6590-43f3-acfb-0d6f8e32199e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (6ef48742-ab48-4943-be3d-66f81f7b972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f40c62-44d5-497d-bac1-73f72f9ec267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f40c62-44d5-497d-bac1-73f72f9ec267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049484990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f946d7-15cc-4769-9b3b-9fcc0f765a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:22Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0252e45-eb56-4188-9862-9d8451efe2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0252e45-eb56-4188-9862-9d8451efe2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175d0e0d-3242-4541-9b2d-a23c0e5634c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175d0e0d-3242-4541-9b2d-a23c0e5634c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f946d7-15cc-4769-9b3b-9fcc0f765a76', 'volume_name': 'volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaa3114-27a1-47fc-87de-5ca1860b9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaa3114-27a1-47fc-87de-5ca1860b9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34206419-3402-446e-8cf8-b5cba1a3ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Volume 35f946d7-15cc-4769-9b3b-9fcc0f765a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76', 'volume_size': 1} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049484990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f946d7-15cc-4769-9b3b-9fcc0f765a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:22Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Creating volume 35f946d7-15cc-4769-9b3b-9fcc0f765a76 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:22 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:22 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 1073741824 Sep 29 12:47:22 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:22 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 1073741824" returned: 0 in 0.571s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:23 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 Sep 29 12:47:23 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:23 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34206419-3402-446e-8cf8-b5cba1a3ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353ec9e7-5d51-49cf-9e85-0e5b2d4f29e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Volume volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 (35f946d7-15cc-4769-9b3b-9fcc0f765a76): created successfully Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353ec9e7-5d51-49cf-9e85-0e5b2d4f29e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (6ef48742-ab48-4943-be3d-66f81f7b972d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-366320b9-cffe-4ffa-b0e8-329584aeaa35 tempest-ProjectReaderTests-1962924705 None] Created volume successfully. Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-35f946d7-15cc-4769-9b3b-9fcc0f765a76-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-35f946d7-15cc-4769-9b3b-9fcc0f765a76-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-quobyte-35f946d7-15cc-4769-9b3b-9fcc0f765a76" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-35f946d7-15cc-4769-9b3b-9fcc0f765a76" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82278c-310e-404f-ae12-cc05719a9410]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:24 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 Sep 29 12:47:24 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:25 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76" returned: 0 in 0.424s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:25 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76 Sep 29 12:47:25 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:25 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-35f946d7-15cc-4769-9b3b-9fcc0f765a76" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-35f946d7-15cc-4769-9b3b-9fcc0f765a76" released by "delete_volume" :: held 0.823s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Created reservations ['b5a9ce1b-550c-4e65-bd1e-f9e5bd97cb39', '3faf3bae-74a6-4c7c-a25c-532c9b646a4c', '2db1174b-e932-4066-8326-47084a66d183', 'd1942106-b0f3-4193-9c21-4108c15129f3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:25 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:25 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:25 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Deleted volume successfully. Sep 29 12:47:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-139116a2-a462-46c4-973b-32d1c2962ea6 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-35f946d7-15cc-4769-9b3b-9fcc0f765a76-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (3e0f10fe-f8a2-4945-b43b-3dd5bb51fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c63a7c-afee-44ca-9154-421073eaedd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c63a7c-afee-44ca-9154-421073eaedd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321055700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef0bde-5d3c-49e6-ac4d-d250655ab57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:26Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea46f02-939a-4570-8e9a-e460f5d72c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea46f02-939a-4570-8e9a-e460f5d72c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80db15bc-0868-4dbc-89aa-2815f4eb9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80db15bc-0868-4dbc-89aa-2815f4eb9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ef0bde-5d3c-49e6-ac4d-d250655ab57b', 'volume_name': 'volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de39ccf-c86d-4c1d-b1b8-460fe3e941c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de39ccf-c86d-4c1d-b1b8-460fe3e941c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a6f6c7-67fe-40ca-a233-37b3ef11edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Volume 49ef0bde-5d3c-49e6-ac4d-d250655ab57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b', 'volume_size': 1} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321055700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef0bde-5d3c-49e6-ac4d-d250655ab57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:26Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Creating volume 49ef0bde-5d3c-49e6-ac4d-d250655ab57b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:26 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b 1073741824 Sep 29 12:47:26 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:27 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b 1073741824" returned: 0 in 0.560s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:27 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b Sep 29 12:47:27 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:27 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" returned: 0 in 0.310s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a6f6c7-67fe-40ca-a233-37b3ef11edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21675a6c-474b-467c-83d0-027c1f191aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Volume volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b (49ef0bde-5d3c-49e6-ac4d-d250655ab57b): created successfully Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21675a6c-474b-467c-83d0-027c1f191aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (3e0f10fe-f8a2-4945-b43b-3dd5bb51fee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1a252067-74d8-45ae-8946-60ef9b73fca8 tempest-ProjectReaderTests-1962924705 None] Created volume successfully. Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-49ef0bde-5d3c-49e6-ac4d-d250655ab57b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "cinder-49ef0bde-5d3c-49e6-ac4d-d250655ab57b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-quobyte-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed0b3a-2452-416e-a1c6-61f27f165c1f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:28 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b Sep 29 12:47:28 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:29 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" returned: 0 in 0.503s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:29 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b Sep 29 12:47:29 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:29 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" returned: 0 in 0.309s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-49ef0bde-5d3c-49e6-ac4d-d250655ab57b" released by "delete_volume" :: held 0.871s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Created reservations ['1be2b575-3006-49e8-ae2f-ba4b6a728da6', '07c092ad-eca3-415e-9672-bf7c4b2b00ab', 'db83251c-f8e9-4bd5-88fd-27284d9f845d', '4e77058d-b8ab-4695-85e5-ea7ba77a29d9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:29 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:29 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:30 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.429s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Deleted volume successfully. Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:30 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:30 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-50b3c71f-0a1b-4c97-b452-d0e698c59baa tempest-ProjectReaderTests-1962924705 None] Lock "cinder-49ef0bde-5d3c-49e6-ac4d-d250655ab57b-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:30 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (4df0ea48-57e5-47c7-b0fa-7bf434a203b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7923b33e-35dc-44be-9e9e-020f99a0c10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.373s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7923b33e-35dc-44be-9e9e-020f99a0c10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53057036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c77d86-86d3-49b6-bc55-ecd410b24d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:30Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abce465f-a899-41ab-8652-1f9778bbdd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abce465f-a899-41ab-8652-1f9778bbdd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf06cd5-e6b6-4781-b5aa-cceab4de71fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf06cd5-e6b6-4781-b5aa-cceab4de71fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c77d86-86d3-49b6-bc55-ecd410b24d38', 'volume_name': 'volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955dd2f7-589f-4d4c-b2f6-609ac9e27516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955dd2f7-589f-4d4c-b2f6-609ac9e27516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522ee0f6-bdb8-4c0b-bafa-275d04a8d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Volume c8c77d86-86d3-49b6-bc55-ecd410b24d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38', 'volume_size': 1} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53057036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c77d86-86d3-49b6-bc55-ecd410b24d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dad007e3ac842aa9e8c287e338d60b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:30Z,use_quota=True,user_id='31b0a5ba74e14157aae3a38c62c3d6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Creating volume c8c77d86-86d3-49b6-bc55-ecd410b24d38 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:47:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:47:30 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 1073741824 Sep 29 12:47:30 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:31 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 1073741824" returned: 0 in 0.734s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:31 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 Sep 29 12:47:31 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:31 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522ee0f6-bdb8-4c0b-bafa-275d04a8d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec5e18-65f3-438f-b577-2865e070264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Volume volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 (c8c77d86-86d3-49b6-bc55-ecd410b24d38): created successfully Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec5e18-65f3-438f-b577-2865e070264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Flow 'volume_create_manager' (4df0ea48-57e5-47c7-b0fa-7bf434a203b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1153517-3f47-48eb-9a59-72d02f290986 tempest-ProjectReaderTests-1962924705 None] Created volume successfully. Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-c8c77d86-86d3-49b6-bc55-ecd410b24d38-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-c8c77d86-86d3-49b6-bc55-ecd410b24d38-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "cinder-quobyte-c8c77d86-86d3-49b6-bc55-ecd410b24d38" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-c8c77d86-86d3-49b6-bc55-ecd410b24d38" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b0f0b8-5816-491b-bade-75c68814fdf9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:32 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 Sep 29 12:47:32 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:33 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38" returned: 0 in 0.460s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:33 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38 Sep 29 12:47:33 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:33 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c8c77d86-86d3-49b6-bc55-ecd410b24d38" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-quobyte-c8c77d86-86d3-49b6-bc55-ecd410b24d38" released by "delete_volume" :: held 0.837s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Created reservations ['67cd2518-d882-43aa-9429-293521d6fb3c', '81f684db-baab-4618-a5b3-0afdfcafecfe', '2fff175c-e574-4e84-9842-6da1e300bd6c', '2a8e912a-a94f-4334-9b46-83fa56f3e0ba'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:33 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:47:33 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:34 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:47:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Deleted volume successfully. Sep 29 12:47:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d19549bc-452e-4bed-a491-794ca1184688 tempest-ProjectReaderTests-1962924705 None] Lock "cinder-c8c77d86-86d3-49b6-bc55-ecd410b24d38-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:47:43 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=94,cinder:INSERT=34,cinder:UPDATE=138,cinder:DELETE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:47:44 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=102,cinder:UPDATE=151,cinder:INSERT=36,cinder:DELETE=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Flow 'volume_create_manager' (0c4bc8c4-72ca-46f7-bb3a-8b965d883ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fd02a9-2bd0-40f5-8e20-c67a554a88e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fd02a9-2bd0-40f5-8e20-c67a554a88e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284125820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47aa253-a0ac-4691-b288-f891657c548b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c516394af544c6abe1ff59189f6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:48Z,use_quota=True,user_id='1d970aea7e15469a96d9e22e96367584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97b1ebf-1c98-4614-b044-4cecc6b4cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97b1ebf-1c98-4614-b044-4cecc6b4cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7cb41b-5c39-4ab1-a907-26f80c242a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7cb41b-5c39-4ab1-a907-26f80c242a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47aa253-a0ac-4691-b288-f891657c548b', 'volume_name': 'volume-a47aa253-a0ac-4691-b288-f891657c548b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f9d300-e84e-45a8-8970-cd4b667c12aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f9d300-e84e-45a8-8970-cd4b667c12aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa99a7c-0751-4d89-bdbd-70f5c9806605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Volume a47aa253-a0ac-4691-b288-f891657c548b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47aa253-a0ac-4691-b288-f891657c548b', 'volume_size': 1} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284125820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47aa253-a0ac-4691-b288-f891657c548b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c516394af544c6abe1ff59189f6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:48Z,use_quota=True,user_id='1d970aea7e15469a96d9e22e96367584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Creating volume a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:48 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b 1073741824 Sep 29 12:47:48 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:48 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b 1073741824" returned: 0 in 0.540s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:49 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:47:49 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:49 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa99a7c-0751-4d89-bdbd-70f5c9806605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47aa253-a0ac-4691-b288-f891657c548b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759f34b8-efe0-49c6-b2ae-47871dbfc870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Volume volume-a47aa253-a0ac-4691-b288-f891657c548b (a47aa253-a0ac-4691-b288-f891657c548b): created successfully Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759f34b8-efe0-49c6-b2ae-47871dbfc870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Flow 'volume_create_manager' (0c4bc8c4-72ca-46f7-bb3a-8b965d883ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-05a5d452-1c90-463f-95f7-6b5424be375c tempest-SnapshotDependencyTests-1950986074 None] Created volume successfully. Sep 29 12:47:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Creating offline snapshot 1b203ea3-5921-4893-9f87-74eb3b6f24a6 of volume a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:47:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e4cda-42e3-40ef-806c-22b314d551a4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:50 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:47:50 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:51 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.406s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:51 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 1G Sep 29 12:47:51 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:51 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 1G" returned: 0 in 0.519s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47aa253-a0ac-4691-b288-f891657c548b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:51 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47aa253-a0ac-4691-b288-f891657c548b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:47:51 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:51 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47aa253-a0ac-4691-b288-f891657c548b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.304s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:51 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 is being set with open permissions: ugo+rw Sep 29 12:47:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:51 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:47:51 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:52 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:52 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info Sep 29 12:47:52 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:52 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info" returned: 0 in 0.251s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:52 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info is being set with open permissions: ugo+rw Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:52 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info Sep 29 12:47:52 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:52 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.info" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-214308fa-9c22-4db5-b08b-584dbed993af tempest-SnapshotDependencyTests-1950986074 None] Create snapshot completed successfully Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Flow 'volume_create_manager' (edf0cd93-5f80-4495-a8c4-cff617a3150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9484cd-017e-465b-b690-9d806279a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9484cd-017e-465b-b690-9d806279a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e00db59-c197-4850-a65d-ae0e0c37cc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c516394af544c6abe1ff59189f6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b203ea3-5921-4893-9f87-74eb3b6f24a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:47:54Z,use_quota=True,user_id='1d970aea7e15469a96d9e22e96367584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af053655-88fc-4bf3-859e-025deac9dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af053655-88fc-4bf3-859e-025deac9dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143d88b6-5d47-4dda-819d-aacf24bfe0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143d88b6-5d47-4dda-819d-aacf24bfe0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e00db59-c197-4850-a65d-ae0e0c37cc48', 'volume_name': 'volume-2e00db59-c197-4850-a65d-ae0e0c37cc48', 'volume_size': 1, 'snapshot_id': '1b203ea3-5921-4893-9f87-74eb3b6f24a6'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ccba2a-71ad-4299-a576-ad2491289711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ccba2a-71ad-4299-a576-ad2491289711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c579b43f-3055-49a0-b401-4f1e71b651c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:47:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Volume 2e00db59-c197-4850-a65d-ae0e0c37cc48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e00db59-c197-4850-a65d-ae0e0c37cc48', 'volume_size': 1, 'snapshot_id': '1b203ea3-5921-4893-9f87-74eb3b6f24a6'} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6-2e00db59-c197-4850-a65d-ae0e0c37cc48" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6-2e00db59-c197-4850-a65d-ae0e0c37cc48" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Creating volume 2e00db59-c197-4850-a65d-ae0e0c37cc48 from snapshot 1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] snapshot: 1b203ea3-5921-4893-9f87-74eb3b6f24a6, volume: 2e00db59-c197-4850-a65d-ae0e0c37cc48, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb00b651-952a-4c4f-a6d5-cc606a508c94]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:54 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:47:54 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:55 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a47aa253-a0ac-4691-b288-f891657c548b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ae9ff7-dc81-468c-82de-1049985d67c9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:55 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:47:55 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:47:55 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.382s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:47:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:47:55 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 Sep 29 12:47:55 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:02 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48" returned: 0 in 7.475s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:02 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:48:02 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Converted 1024.00 MB image at 136.96 MB/s Sep 29 12:48:02 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 is being set with open permissions: ugo+rw Sep 29 12:48:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:02 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 Sep 29 12:48:02 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:03 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" released by "_copy_volume_from_snapshot" :: held 8.643s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6-2e00db59-c197-4850-a65d-ae0e0c37cc48" released by "_create_volume_from_snapshot" :: held 8.714s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.733s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c579b43f-3055-49a0-b401-4f1e71b651c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e00db59-c197-4850-a65d-ae0e0c37cc48', 'volume_size': 1, 'snapshot_id': '1b203ea3-5921-4893-9f87-74eb3b6f24a6'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d4c6ff-641d-4e1a-b6d9-9fe1eb86f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Volume volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 (2e00db59-c197-4850-a65d-ae0e0c37cc48): created successfully Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d4c6ff-641d-4e1a-b6d9-9fe1eb86f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Flow 'volume_create_manager' (edf0cd93-5f80-4495-a8c4-cff617a3150e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:48:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-562fb21d-8d00-4647-99b8-c76cca1e956a tempest-SnapshotDependencyTests-1950986074 None] Created volume successfully. Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-1b203ea3-5921-4893-9f87-74eb3b6f24a6-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-1b203ea3-5921-4893-9f87-74eb3b6f24a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Deleting offline snapshot 1b203ea3-5921-4893-9f87-74eb3b6f24a6 of volume a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] snapshot_file for this snap is: volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435c959-5656-4d1e-9573-0db49a81c859]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:04 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:48:04 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:04 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a47aa253-a0ac-4691-b288-f891657c548b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e32459-9e7e-4b87-bd34-4ec4b570ef5a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:04 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:48:04 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Flow 'volume_create_manager' (22704994-335d-4207-8651-c29393336137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be45f785-7c10-4d88-bc5d-f6d0b1172cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be45f785-7c10-4d88-bc5d-f6d0b1172cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-155078112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18fa1c4-aecf-4753-b62c-0a2ab1986fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dcc32cc87c47bdad1db965e58ce3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:48:05Z,use_quota=True,user_id='712b19138bb74a1b99bb27eda41bd2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5161970-ad0c-401f-9a1f-88a68d7dedee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5161970-ad0c-401f-9a1f-88a68d7dedee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a13696-8bab-4e97-a116-453458a0b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a13696-8bab-4e97-a116-453458a0b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18fa1c4-aecf-4753-b62c-0a2ab1986fd0', 'volume_name': 'volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef00b4-445e-428b-bdb1-700bbf920f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef00b4-445e-428b-bdb1-700bbf920f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e1e153-c1f0-4125-a703-f89172aa6789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Volume c18fa1c4-aecf-4753-b62c-0a2ab1986fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0', 'volume_size': 1} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-155078112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18fa1c4-aecf-4753-b62c-0a2ab1986fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dcc32cc87c47bdad1db965e58ce3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:48:05Z,use_quota=True,user_id='712b19138bb74a1b99bb27eda41bd2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Creating volume c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:48:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:05 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 1073741824 Sep 29 12:48:05 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:05 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.603s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:05 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:48:05 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:05 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 1073741824" returned: 0 in 0.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:05 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:05 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:05 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.372s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:05 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6 Sep 29 12:48:05 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:06 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e1e153-c1f0-4125-a703-f89172aa6789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72efe12-d78e-4b08-9ff4-08c844887e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:48:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Volume volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 (c18fa1c4-aecf-4753-b62c-0a2ab1986fd0): created successfully Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72efe12-d78e-4b08-9ff4-08c844887e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Flow 'volume_create_manager' (22704994-335d-4207-8651-c29393336137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:48:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d31de88c-6de2-4868-a110-27e2c4935c12 tempest-TestImageHashVerification-645843148 None] Created volume successfully. Sep 29 12:48:06 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b.1b203ea3-5921-4893-9f87-74eb3b6f24a6" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-1b203ea3-5921-4893-9f87-74eb3b6f24a6" released by "_delete_snapshot" :: held 1.745s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" released by "delete_snapshot" :: held 1.768s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Created reservations ['b494fbf7-9bea-4b9d-905a-c64b5d2bcaea', 'b6c521fd-174b-4354-b6ab-d0eb9b51814a', '4509301c-1740-4d34-a785-e94cf72658dc', 'a2f5f83b-b269-4aa4-9f06-dfb4733982b0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:48:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Delete snapshot completed successfully. Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2cfb466d-d82b-46e7-8830-be6385494c19 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-1b203ea3-5921-4893-9f87-74eb3b6f24a6-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-a47aa253-a0ac-4691-b288-f891657c548b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-a47aa253-a0ac-4691-b288-f891657c548b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[51874e53-d482-4815-a7c7-33de2e00cd7a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:06 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:48:06 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:06 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:06 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b Sep 29 12:48:06 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf516f-63e2-4eed-9eee-81bd65dbf86b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:07 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:07 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:07 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-a47aa253-a0ac-4691-b288-f891657c548b" returned: 0 in 0.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-a47aa253-a0ac-4691-b288-f891657c548b" released by "delete_volume" :: held 0.701s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Created reservations ['f4e9ba3b-84f7-48e8-a09f-6bcd04ef0fdd', '8657c9b9-d637-44a5-9911-353fcb00fae9', '23765ec1-f76f-4eec-8fdb-fd33ea45f5fc', '2b66a402-5572-4294-a1ab-d592bf00bf31'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:07 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:48:07 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:07 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cdb432-feb4-481f-aaae-a9651aed6dfa]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:07 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:07 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:07 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-2e00db59-c197-4850-a65d-ae0e0c37cc48-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Deleted volume successfully. Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-2e00db59-c197-4850-a65d-ae0e0c37cc48-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a64667c-176b-4a2c-b651-6c19d8fddf3d tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-a47aa253-a0ac-4691-b288-f891657c548b-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5816e6e-4645-405f-ae6c-5038d6084bb8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:07 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 /opt/stack/data/cinder/conversion/c18fa1c4-aecf-4753-b62c-0a2ab1986fd0.temp_image.6b8e6703-5d32-4a9b-a0d6-b501ec999d1fryint_jt.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:07 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 Sep 29 12:48:07 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:07 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 /opt/stack/data/cinder/conversion/c18fa1c4-aecf-4753-b62c-0a2ab1986fd0.temp_image.6b8e6703-5d32-4a9b-a0d6-b501ec999d1fryint_jt.img Sep 29 12:48:07 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:08 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48" returned: 0 in 0.376s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:08 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48 Sep 29 12:48:08 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:08 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-2e00db59-c197-4850-a65d-ae0e0c37cc48" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-quobyte-2e00db59-c197-4850-a65d-ae0e0c37cc48" released by "delete_volume" :: held 0.828s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Created reservations ['4a0291e2-e592-4089-ba40-8975f88a1028', '621ef1c5-d600-4cf4-b672-31c4acc8cb32', 'ca8d5e6f-63fd-4d19-9aec-1e9f54015d7a', 'd661d547-b2db-43ea-85f4-b0578f6a74b0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:08 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:48:08 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:09 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.354s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:48:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Deleted volume successfully. Sep 29 12:48:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1e3ef13c-54e7-4619-8c75-d9fb962be8a1 tempest-SnapshotDependencyTests-1950986074 None] Lock "cinder-2e00db59-c197-4850-a65d-ae0e0c37cc48-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:14 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 /opt/stack/data/cinder/conversion/c18fa1c4-aecf-4753-b62c-0a2ab1986fd0.temp_image.6b8e6703-5d32-4a9b-a0d6-b501ec999d1fryint_jt.img" returned: 0 in 6.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e8c5b-64a3-4fea-a544-df1c474d95e0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:14 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:14 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:15 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.588s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/conversion/c18fa1c4-aecf-4753-b62c-0a2ab1986fd0.temp_image.6b8e6703-5d32-4a9b-a0d6-b501ec999d1fryint_jt.img {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:48:15 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Converted 1024.00 MB image at 156.11 MB/s Sep 29 12:48:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] 6b8e6703-5d32-4a9b-a0d6-b501ec999d1f was raw, no need to convert to raw {{(pid=86763) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 12:48:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=31,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:48:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=31,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:30 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:48:30 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:30 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:48:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:48:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.159s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Uploaded volume to glance image-id: 6b8e6703-5d32-4a9b-a0d6-b501ec999d1f. {{(pid=86763) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:48:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-94a1fbbc-b6ec-4b47-829e-adb8abcb900f tempest-TestImageHashVerification-645843148 None] Copy volume to image completed successfully. Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Acquiring lock "cinder-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "cinder-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Acquiring lock "cinder-quobyte-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "cinder-quobyte-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[151de32b-5094-4ab4-b469-2a0fa7adadab]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:48:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:35 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:35 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:36 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.404s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:36 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0 Sep 29 12:48:36 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:36 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "cinder-quobyte-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0" released by "delete_volume" :: held 0.696s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Created reservations ['a35cd8f2-8392-44b1-bb86-2c4c49f925e1', 'd00f502b-bc2c-48b1-85b1-6cfb49e9b67c', '3557908c-3e48-4edb-8303-11582bc630aa', 'ff56b62a-676f-4611-8105-63386bd25721'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:48:36 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:48:36 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:48:36 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:48:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Deleted volume successfully. Sep 29 12:48:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-970a6d35-59fc-4e70-af1b-6f599173efb9 tempest-TestImageHashVerification-645843148 None] Lock "cinder-c18fa1c4-aecf-4753-b62c-0a2ab1986fd0-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:48:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:48:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Flow 'volume_create_manager' (f12684e9-a1a3-448f-9028-bbafdfbbc295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1cb41c-2c58-4dd5-ac12-18c1e865631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1cb41c-2c58-4dd5-ac12-18c1e865631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-165430882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5860bc1e-e3cb-4def-a57b-d3e36d209140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8285743cde4eb191632022aa8eb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:49:08Z,use_quota=True,user_id='0e99c30357874526a27d81385033543d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b677bb-772f-4b7b-93c2-0759c9ee1def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b677bb-772f-4b7b-93c2-0759c9ee1def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59f84a5-4543-4354-8d37-72eeb08ee2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59f84a5-4543-4354-8d37-72eeb08ee2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5860bc1e-e3cb-4def-a57b-d3e36d209140', 'volume_name': 'volume-5860bc1e-e3cb-4def-a57b-d3e36d209140', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294cca23-9432-4be7-9002-5f08538f5149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294cca23-9432-4be7-9002-5f08538f5149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfc0f1-3aa7-4b19-ad0e-870c9a9867da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Volume 5860bc1e-e3cb-4def-a57b-d3e36d209140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5860bc1e-e3cb-4def-a57b-d3e36d209140', 'volume_size': 1} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-165430882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5860bc1e-e3cb-4def-a57b-d3e36d209140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8285743cde4eb191632022aa8eb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:49:08Z,use_quota=True,user_id='0e99c30357874526a27d81385033543d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Creating volume 5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:49:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:49:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:07 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 1073741824 Sep 29 12:49:07 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:08 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 1073741824" returned: 0 in 0.454s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:08 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:49:08 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:08 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfc0f1-3aa7-4b19-ad0e-870c9a9867da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5860bc1e-e3cb-4def-a57b-d3e36d209140', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab6cd2f-f871-4620-8d59-7d1fca36266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Volume volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 (5860bc1e-e3cb-4def-a57b-d3e36d209140): created successfully Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab6cd2f-f871-4620-8d59-7d1fca36266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Flow 'volume_create_manager' (f12684e9-a1a3-448f-9028-bbafdfbbc295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:49:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-da670010-5609-4264-8033-5cde8606447d tempest-TestStampPattern-806511618 None] Created volume successfully. Sep 29 12:49:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:49:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:30 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:49:30 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:30 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.233s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:49:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:49:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9a776605-9e55-4247-80c0-039514480106 req-72e08429-4bd2-4c86-bf37-e519b0190a86 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9a776605-9e55-4247-80c0-039514480106 req-72e08429-4bd2-4c86-bf37-e519b0190a86 tempest-TestStampPattern-806511618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-9a776605-9e55-4247-80c0-039514480106 req-72e08429-4bd2-4c86-bf37-e519b0190a86 tempest-TestStampPattern-806511618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9a776605-9e55-4247-80c0-039514480106 req-72e08429-4bd2-4c86-bf37-e519b0190a86 tempest-TestStampPattern-806511618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-5860bc1e-e3cb-4def-a57b-d3e36d209140', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4547635-a8c8-4eac-8cfc-457822171669', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:49:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9a776605-9e55-4247-80c0-039514480106 req-72e08429-4bd2-4c86-bf37-e519b0190a86 tempest-TestStampPattern-806511618 None] attachment_update completed successfully. Sep 29 12:49:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-a8c199ee-427b-44c2-8c77-afee9ddabe15 req-b06048b4-2452-4c7a-bd98-59ccc2a5b4ec tempest-TestStampPattern-806511618 None] Terminate volume connection completed successfully. Sep 29 12:49:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-a8c199ee-427b-44c2-8c77-afee9ddabe15 req-b06048b4-2452-4c7a-bd98-59ccc2a5b4ec tempest-TestStampPattern-806511618 None] Deleting attachment a4547635-a8c8-4eac-8cfc-457822171669. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:49:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Creating offline snapshot cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 of volume 5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:49:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc3c369-37f7-4d5e-bf26-c3ded484c90c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:49:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:45 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:49:45 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:46 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:46 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 1G Sep 29 12:49:46 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:46 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 1G" returned: 0 in 0.428s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:46 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:49:46 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:46 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:46 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 is being set with open permissions: ugo+rw Sep 29 12:49:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:46 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:49:46 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:47 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:47 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info Sep 29 12:49:47 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:47 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info" returned: 0 in 0.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:47 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info is being set with open permissions: ugo+rw Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:47 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info Sep 29 12:49:47 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:47 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.info" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1bd86ba-c81d-4c80-b65d-993f8bd14208 tempest-TestStampPattern-806511618 None] Create snapshot completed successfully Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Flow 'volume_create_manager' (c1ed952f-111d-4baf-a478-e60422bcad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc0690-a048-4879-b71d-127cb58df8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc0690-a048-4879-b71d-127cb58df8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2142331978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076bc850-e413-426f-b3b2-3410249f4feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8285743cde4eb191632022aa8eb0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd3ff3f4-a87f-4203-a83c-f7c99b35cb52,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:49:54Z,use_quota=True,user_id='0e99c30357874526a27d81385033543d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5768ab36-b475-482f-9a4b-fc639817e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5768ab36-b475-482f-9a4b-fc639817e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e4aec-2d3e-450f-9a4e-613d6a734f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e4aec-2d3e-450f-9a4e-613d6a734f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '076bc850-e413-426f-b3b2-3410249f4feb', 'volume_name': 'volume-076bc850-e413-426f-b3b2-3410249f4feb', 'volume_size': 1, 'snapshot_id': 'cd3ff3f4-a87f-4203-a83c-f7c99b35cb52'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a4729-e8ac-4a12-8a50-e4f4f1c58b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a4729-e8ac-4a12-8a50-e4f4f1c58b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a29800e-3f4a-4457-86bb-98f3a6924682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:49:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Volume 076bc850-e413-426f-b3b2-3410249f4feb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-076bc850-e413-426f-b3b2-3410249f4feb', 'volume_size': 1, 'snapshot_id': 'cd3ff3f4-a87f-4203-a83c-f7c99b35cb52'} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-076bc850-e413-426f-b3b2-3410249f4feb" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-076bc850-e413-426f-b3b2-3410249f4feb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Creating volume 076bc850-e413-426f-b3b2-3410249f4feb from snapshot cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] snapshot: cd3ff3f4-a87f-4203-a83c-f7c99b35cb52, volume: 076bc850-e413-426f-b3b2-3410249f4feb, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[890d171c-f3fe-47c8-96ca-b35374b182ed]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:49:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:54 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:49:54 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:55 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5860bc1e-e3cb-4def-a57b-d3e36d209140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce4f48-2e7e-47bd-bd54-75c75ff6de1f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:55 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:49:55 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:49:55 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.394s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:49:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:49:55 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb Sep 29 12:49:55 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:03 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb" returned: 0 in 8.160s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:50:03 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Converted 1024.00 MB image at 125.46 MB/s Sep 29 12:50:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb is being set with open permissions: ugo+rw Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:03 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb Sep 29 12:50:03 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:03 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" released by "_copy_volume_from_snapshot" :: held 9.374s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-076bc850-e413-426f-b3b2-3410249f4feb" released by "_create_volume_from_snapshot" :: held 9.448s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.466s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:50:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a29800e-3f4a-4457-86bb-98f3a6924682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076bc850-e413-426f-b3b2-3410249f4feb', 'volume_size': 1, 'snapshot_id': 'cd3ff3f4-a87f-4203-a83c-f7c99b35cb52'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:50:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d89c61-8539-4bc8-bd45-c9104ef9e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:50:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Volume volume-076bc850-e413-426f-b3b2-3410249f4feb (076bc850-e413-426f-b3b2-3410249f4feb): created successfully Sep 29 12:50:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d89c61-8539-4bc8-bd45-c9104ef9e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:50:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Flow 'volume_create_manager' (c1ed952f-111d-4baf-a478-e60422bcad1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:50:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bc5c1ec5-a0da-4b71-bd28-d33b21393dd3 tempest-TestStampPattern-806511618 None] Created volume successfully. Sep 29 12:50:14 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:50:14 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=16,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:50:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:50:29 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:30 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:50:30 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:30 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:50:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:50:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a08ff079-8a55-4d19-b5c3-16e7710d1432 req-08571664-3ecb-4580-aa6f-a9ef85e0ed77 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:50:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a08ff079-8a55-4d19-b5c3-16e7710d1432 req-08571664-3ecb-4580-aa6f-a9ef85e0ed77 tempest-TestStampPattern-806511618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:50:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a08ff079-8a55-4d19-b5c3-16e7710d1432 req-08571664-3ecb-4580-aa6f-a9ef85e0ed77 tempest-TestStampPattern-806511618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:50:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-a08ff079-8a55-4d19-b5c3-16e7710d1432 req-08571664-3ecb-4580-aa6f-a9ef85e0ed77 tempest-TestStampPattern-806511618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4', 'name': 'volume-076bc850-e413-426f-b3b2-3410249f4feb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd154241b-aa82-4862-a701-c0ff70f164ea', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:50:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-a08ff079-8a55-4d19-b5c3-16e7710d1432 req-08571664-3ecb-4580-aa6f-a9ef85e0ed77 tempest-TestStampPattern-806511618 None] attachment_update completed successfully. Sep 29 12:50:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-451fc8b6-108d-4e6c-b07d-8e31d809aba5 req-1e94dce3-d825-40d1-b959-26f28cd98881 tempest-TestStampPattern-806511618 None] Terminate volume connection completed successfully. Sep 29 12:50:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-451fc8b6-108d-4e6c-b07d-8e31d809aba5 req-1e94dce3-d825-40d1-b959-26f28cd98881 tempest-TestStampPattern-806511618 None] Deleting attachment d154241b-aa82-4862-a701-c0ff70f164ea. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:50:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-076bc850-e413-426f-b3b2-3410249f4feb-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "cinder-076bc850-e413-426f-b3b2-3410249f4feb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e8a4c-0bbc-4e23-9050-5666e39f3cb3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:53 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb Sep 29 12:50:53 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:53 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb" returned: 0 in 0.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:53 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb Sep 29 12:50:53 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:53 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-076bc850-e413-426f-b3b2-3410249f4feb" returned: 0 in 0.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-076bc850-e413-426f-b3b2-3410249f4feb" released by "delete_volume" :: held 0.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Created reservations ['a27a4b93-7c31-4f16-b5e1-275ed5c2f049', 'b2758509-6464-443d-921e-521b6d092272', 'c9ce2b38-02f7-4176-812b-778fe2ae35c4', '5499e201-a84d-4744-b7ae-3a25e4af47f7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:50:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:53 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:50:53 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:54 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.273s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:50:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Deleted volume successfully. Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c733f464-5646-4df5-9490-4f9f003305ee tempest-TestStampPattern-806511618 None] Lock "cinder-076bc850-e413-426f-b3b2-3410249f4feb-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Deleting offline snapshot cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 of volume 5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] snapshot_file for this snap is: volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0716eff-6cce-4fdf-b366-2cf285b719a9]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:54 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:50:54 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:54 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.360s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5860bc1e-e3cb-4def-a57b-d3e36d209140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fb1052-504d-4fea-a126-24478d9b5ed3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:50:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:54 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:50:54 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:55 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.526s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:55 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:50:55 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:55 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:50:55 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52 Sep 29 12:50:55 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:50:55 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 29 12:50:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140.cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:50:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52" released by "_delete_snapshot" :: held 1.582s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" released by "delete_snapshot" :: held 1.604s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:50:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Created reservations ['dc0ed002-f602-457f-b655-8850cdf8e426', '74491212-5f66-44a0-bd0d-bdafce218f01', 'ff6008b2-427c-4dc6-a4f9-e2b2ced36aed', '63432196-a8ea-4cd7-93a2-d5c8bb735692'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:50:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Delete snapshot completed successfully. Sep 29 12:50:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6e512ed9-7bca-4106-aff2-f40f72254544 tempest-TestStampPattern-806511618 None] Lock "cinder-cd3ff3f4-a87f-4203-a83c-f7c99b35cb52-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-5860bc1e-e3cb-4def-a57b-d3e36d209140-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "cinder-5860bc1e-e3cb-4def-a57b-d3e36d209140-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Acquiring lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dececf1-fc22-48c4-80ac-8341df552b34]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:00 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:51:00 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:00 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:00 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140 Sep 29 12:51:00 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:00 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5860bc1e-e3cb-4def-a57b-d3e36d209140" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "cinder-quobyte-5860bc1e-e3cb-4def-a57b-d3e36d209140" released by "delete_volume" :: held 0.696s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Created reservations ['749e1bb7-a81b-435b-b5eb-12f78298c2c4', '0c89bce3-e78e-41f8-b2b6-88057e7571c9', '317bd2e1-23ef-4cb0-8445-140dd93e09cf', 'd67d4aa7-7347-433d-8ae5-9d67c43c9738'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:00 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:00 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:01 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Deleted volume successfully. Sep 29 12:51:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c555dbe3-8a9f-4695-9fd0-448343da8342 tempest-TestStampPattern-806511618 None] Lock "cinder-5860bc1e-e3cb-4def-a57b-d3e36d209140-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:10 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:51:11 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Flow 'volume_create_manager' (470dce88-4d3e-499d-8e99-b672ffb01562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701ceba7-a7c9-425d-a982-1a52c23ad978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701ceba7-a7c9-425d-a982-1a52c23ad978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0032189b80b24569b650363d20c61845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:16Z,use_quota=True,user_id='da7a56d06b2a47d999b63d5e990307ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff86a77-307f-4213-a991-5b9a6d8776f9),volume_type_id=eff86a77-307f-4213-a991-5b9a6d8776f9)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4acee2-41c9-4d41-9e32-12e54c58260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4acee2-41c9-4d41-9e32-12e54c58260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ab392b-d12d-429a-88f2-19d0db89aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ab392b-d12d-429a-88f2-19d0db89aabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4', 'volume_name': 'volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4', 'volume_size': 1, 'image_id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57924f49d9bc201530507ae940068dd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0032189b80b24569b650363d20c61845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23f3105ad5f1187762059f47b67f88ca2945c7ca9daefbfdd248a08c49d86d03dab1876805bc9efe05a0de0c282f280e4c65053e7f2aba43378265ca718be1af', 'id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ce745c-b16f-4e3d-8d9a-204b7013ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ce745c-b16f-4e3d-8d9a-204b7013ac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b0af22-07e8-435a-97bd-49b45460b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4', 'volume_size': 1, 'image_id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57924f49d9bc201530507ae940068dd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0032189b80b24569b650363d20c61845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23f3105ad5f1187762059f47b67f88ca2945c7ca9daefbfdd248a08c49d86d03dab1876805bc9efe05a0de0c282f280e4c65053e7f2aba43378265ca718be1af', 'id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Trying to clone 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 from image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:51:15 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b6b8a-231d-4c07-a976-7bfe741e297e]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:16 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:16 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:16 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:16 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:16 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:16 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Temporary image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 is fetched for user da7a56d06b2a47d999b63d5e990307ce. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc680d-d62e-4dda-8b65-8852a0c26cc6]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:16 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:16 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:17 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:17 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:17 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:17 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0032189b80b24569b650363d20c61845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:16Z,use_quota=True,user_id='da7a56d06b2a47d999b63d5e990307ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff86a77-307f-4213-a991-5b9a6d8776f9),volume_type_id=eff86a77-307f-4213-a991-5b9a6d8776f9)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Creating volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:17 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1073741824 Sep 29 12:51:17 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:17 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1073741824" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:17 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 Sep 29 12:51:17 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:18 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" returned: 0 in 0.236s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Attempting download of efda59f2-c9c0-49d6-b6db-cfd2ff310e84 ((None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}])) to volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d3d00-8dfc-4c10-b21c-3277da811acd]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:18 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy Sep 29 12:51:18 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:18 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy" returned: 0 in 0.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:18 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy Sep 29 12:51:18 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:18 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy" returned: 1 in 0.336s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_11vi3hsy' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd17c854-0195-4397-8f91-c2441db2483c]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:19 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:19 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:19 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:19 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD Sep 29 12:51:19 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:19 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] efda59f2-c9c0-49d6-b6db-cfd2ff310e84 was raw, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:51:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:19 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 Sep 29 12:51:19 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:20 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_efda59f2-c9c0-49d6-b6db-cfd2ff310e84_dquvnsvcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:51:20 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:20 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1G Sep 29 12:51:20 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:20 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 1G" returned: 0 in 0.313s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Downloaded image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 ((None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}])) to volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Temporary image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 for user da7a56d06b2a47d999b63d5e990307ce is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Marking volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Copying metadata from image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 to 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Creating volume glance metadata for volume 8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 backed by image efda59f2-c9c0-49d6-b6db-cfd2ff310e84 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '57924f49d9bc201530507ae940068dd0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b0af22-07e8-435a-97bd-49b45460b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4', 'volume_size': 1, 'image_id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57924f49d9bc201530507ae940068dd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0032189b80b24569b650363d20c61845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23f3105ad5f1187762059f47b67f88ca2945c7ca9daefbfdd248a08c49d86d03dab1876805bc9efe05a0de0c282f280e4c65053e7f2aba43378265ca718be1af', 'id': 'efda59f2-c9c0-49d6-b6db-cfd2ff310e84', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efda59f2-c9c0-49d6-b6db-cfd2ff310e84/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dca7aa1-f75c-479b-a64d-d087d7ef95b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Volume volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 (8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4): created successfully Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dca7aa1-f75c-479b-a64d-d087d7ef95b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Flow 'volume_create_manager' (470dce88-4d3e-499d-8e99-b672ffb01562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c3841061-69f1-4ff0-a310-f81af2225fef tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Created volume successfully. Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Acquiring lock "cinder-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "cinder-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Acquiring lock "cinder-quobyte-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "cinder-quobyte-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[134dc9b9-df9e-4c60-8270-fbc1e9c492d3]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:21 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 Sep 29 12:51:21 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:21 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:21 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4 Sep 29 12:51:21 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:21 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "cinder-quobyte-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4" released by "delete_volume" :: held 0.645s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:21 devstack cinder-volume[86763]: WARNING cinder.quota [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:51:21 devstack cinder-volume[86763]: WARNING cinder.quota [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Created reservations ['d1bec930-01b7-477c-b948-e3a40d061f1f', '7aa20729-f99e-4448-9372-b684d7d973b1', 'efb998fd-dcd5-41a9-80aa-8408f5591da1', 'fe30fc36-139e-41f9-bda3-d5e617945093'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:21 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:21 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:21 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.236s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Deleted volume successfully. Sep 29 12:51:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b1cad2-1061-4280-a2e0-fa7f65c8cd7d tempest-VolumeAndVolumeTypeFromImageTest-1569129372 None] Lock "cinder-8fb8ef7b-0725-4c1b-9e98-d4c3d6c6d4c4-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (1933b1f2-a6ad-4e37-bf2c-84803e76ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ace82-429b-4c47-b51b-84dd487fd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ace82-429b-4c47-b51b-84dd487fd52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802166969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b294d-e1b9-47b4-9420-9e4f65d317e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:26Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e2a369-feb0-4b5b-9380-602cbf7b053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e2a369-feb0-4b5b-9380-602cbf7b053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a367cde-2822-4f4a-bea1-42801be9268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a367cde-2822-4f4a-bea1-42801be9268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5b294d-e1b9-47b4-9420-9e4f65d317e9', 'volume_name': 'volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f992a07f-38dd-4587-b910-644b63cde648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f992a07f-38dd-4587-b910-644b63cde648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e6a1cf-8412-48ae-a47b-ea1c608d0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Volume fc5b294d-e1b9-47b4-9420-9e4f65d317e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9', 'volume_size': 1} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802166969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b294d-e1b9-47b4-9420-9e4f65d317e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:26Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Creating volume fc5b294d-e1b9-47b4-9420-9e4f65d317e9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:26 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 1073741824 Sep 29 12:51:26 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (81fa088d-1ba6-42c0-8dd5-e22b0ed8b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a0802b-a9b6-483e-abb0-85d285d9d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a0802b-a9b6-483e-abb0-85d285d9d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797975799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47398204-3e0d-4053-99d2-94a63773b074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:26Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757157fd-1d66-4d09-b719-01a5e04edccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757157fd-1d66-4d09-b719-01a5e04edccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e60110-83e1-4b76-92c7-b3655a7790fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e60110-83e1-4b76-92c7-b3655a7790fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47398204-3e0d-4053-99d2-94a63773b074', 'volume_name': 'volume-47398204-3e0d-4053-99d2-94a63773b074', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e93f0-a53c-419e-96df-8fa13c6d037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e93f0-a53c-419e-96df-8fa13c6d037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bd3725-6fbe-4310-86d3-0054a2556ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Volume 47398204-3e0d-4053-99d2-94a63773b074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47398204-3e0d-4053-99d2-94a63773b074', 'volume_size': 1} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:26 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 1073741824" returned: 0 in 0.510s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:26 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 Sep 29 12:51:26 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (624267de-1a68-441e-a5dc-f7b7e78eab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb10956-b908-412c-875a-42441777ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb10956-b908-412c-875a-42441777ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067554578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307effe5-379f-4fc3-a678-e06d343b68d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:27Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2808c9fe-a7aa-491d-a4b5-a736be1b2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2808c9fe-a7aa-491d-a4b5-a736be1b2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89279f27-f304-4f7b-b06b-dbe69df17d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89279f27-f304-4f7b-b06b-dbe69df17d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307effe5-379f-4fc3-a678-e06d343b68d9', 'volume_name': 'volume-307effe5-379f-4fc3-a678-e06d343b68d9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a57c85-d519-4d62-bed5-d9663cfa111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a57c85-d519-4d62-bed5-d9663cfa111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bbccee-f244-40a1-bb0a-fbd67dd8d681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Volume 307effe5-379f-4fc3-a678-e06d343b68d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307effe5-379f-4fc3-a678-e06d343b68d9', 'volume_size': 1} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:26 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797975799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47398204-3e0d-4053-99d2-94a63773b074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:26Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Creating volume 47398204-3e0d-4053-99d2-94a63773b074 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e6a1cf-8412-48ae-a47b-ea1c608d0b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 1073741824 Sep 29 12:51:27 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de6e8a5-e216-4f2d-9b99-e0377c219988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Volume volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 (fc5b294d-e1b9-47b4-9420-9e4f65d317e9): created successfully Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de6e8a5-e216-4f2d-9b99-e0377c219988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (1933b1f2-a6ad-4e37-bf2c-84803e76ed18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b22de6e5-7c85-40c2-a6a8-2c662469c6b1 tempest-CreateVolumesFromImageTest-891068580 None] Created volume successfully. Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (bb20b427-567b-4425-975e-0da756ccc5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f86618-f193-4531-8d29-3bf9579bcdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f86618-f193-4531-8d29-3bf9579bcdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832222855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c6e380-0ec5-4376-865a-7eabffc5a8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:27Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4374b1a-258a-4447-9b88-8c0a0bcc34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4374b1a-258a-4447-9b88-8c0a0bcc34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e37d36d-5b8b-4da0-aba9-aa8d7b7231cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e37d36d-5b8b-4da0-aba9-aa8d7b7231cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c6e380-0ec5-4376-865a-7eabffc5a8a2', 'volume_name': 'volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08279c13-7a48-46aa-8774-21541a43e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08279c13-7a48-46aa-8774-21541a43e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abfc83d-7220-40c9-8265-7782b60ec15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Volume 28c6e380-0ec5-4376-865a-7eabffc5a8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2', 'volume_size': 1} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:27 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 1073741824" returned: 0 in 0.568s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (9e0b48a7-906b-4823-afd6-dc3ceda24b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6133724e-4e26-43ca-b3f7-71c64a253738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:27 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6133724e-4e26-43ca-b3f7-71c64a253738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095819058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05d98a-85ff-45d8-b157-607ab0317016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:28Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c7a1ba-7764-4072-8cc1-26ef4783c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c7a1ba-7764-4072-8cc1-26ef4783c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bdf0a5-1f51-4f23-8bd9-fe59ba6a18ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bdf0a5-1f51-4f23-8bd9-fe59ba6a18ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c05d98a-85ff-45d8-b157-607ab0317016', 'volume_name': 'volume-0c05d98a-85ff-45d8-b157-607ab0317016', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc46fbb-bf4b-42e0-a84f-a949e7670438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc46fbb-bf4b-42e0-a84f-a949e7670438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05081a12-64e5-4a51-9767-a46d8ad2df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Volume 0c05d98a-85ff-45d8-b157-607ab0317016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c05d98a-85ff-45d8-b157-607ab0317016', 'volume_size': 1} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:27 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.035s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067554578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307effe5-379f-4fc3-a678-e06d343b68d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:27Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Creating volume 307effe5-379f-4fc3-a678-e06d343b68d9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bd3725-6fbe-4310-86d3-0054a2556ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47398204-3e0d-4053-99d2-94a63773b074', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 1073741824 Sep 29 12:51:27 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec66fc80-0dae-4e6e-97a5-6d89bc2124d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Volume volume-47398204-3e0d-4053-99d2-94a63773b074 (47398204-3e0d-4053-99d2-94a63773b074): created successfully Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec66fc80-0dae-4e6e-97a5-6d89bc2124d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (81fa088d-1ba6-42c0-8dd5-e22b0ed8b871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ea4337f4-5a5d-4454-957b-51eb1676f533 tempest-CreateVolumesFromImageTest-891068580 None] Created volume successfully. Sep 29 12:51:28 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 1073741824" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:28 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 Sep 29 12:51:28 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:28 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9" returned: 0 in 0.242s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832222855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c6e380-0ec5-4376-865a-7eabffc5a8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:27Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Creating volume 28c6e380-0ec5-4376-865a-7eabffc5a8a2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:28 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 1073741824 Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bbccee-f244-40a1-bb0a-fbd67dd8d681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307effe5-379f-4fc3-a678-e06d343b68d9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:28 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb029ea7-eb00-49c4-b61b-b4a2f9a854d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Volume volume-307effe5-379f-4fc3-a678-e06d343b68d9 (307effe5-379f-4fc3-a678-e06d343b68d9): created successfully Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb029ea7-eb00-49c4-b61b-b4a2f9a854d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (624267de-1a68-441e-a5dc-f7b7e78eab84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1166232-d927-4b9b-8e9e-b311a49b5f39 tempest-CreateVolumesFromImageTest-891068580 None] Created volume successfully. Sep 29 12:51:29 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 1073741824" returned: 0 in 0.405s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:29 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 Sep 29 12:51:29 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:29 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2" returned: 0 in 0.238s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095819058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05d98a-85ff-45d8-b157-607ab0317016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6fc1441e384dd3bfd9f58c6664138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:28Z,use_quota=True,user_id='0c92d7a6d47240d1b0086d5e666ab6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Creating volume 0c05d98a-85ff-45d8-b157-607ab0317016 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:29 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abfc83d-7220-40c9-8265-7782b60ec15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:29 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 1073741824 Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6df1b54-943c-4624-b066-1d90c415a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:29 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Volume volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 (28c6e380-0ec5-4376-865a-7eabffc5a8a2): created successfully Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6df1b54-943c-4624-b066-1d90c415a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (bb20b427-567b-4425-975e-0da756ccc5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dad1dfd6-3697-4a7b-af11-857ff8244cc2 tempest-CreateVolumesFromImageTest-891068580 None] Created volume successfully. Sep 29 12:51:29 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 1073741824" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:29 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 Sep 29 12:51:29 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:30 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05081a12-64e5-4a51-9767-a46d8ad2df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c05d98a-85ff-45d8-b157-607ab0317016', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d494dd-ccd7-46ae-9112-3b3babbbb90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Volume volume-0c05d98a-85ff-45d8-b157-607ab0317016 (0c05d98a-85ff-45d8-b157-607ab0317016): created successfully Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d494dd-ccd7-46ae-9112-3b3babbbb90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Flow 'volume_create_manager' (9e0b48a7-906b-4823-afd6-dc3ceda24b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-01047455-2b19-414a-b336-005a760638c7 tempest-CreateVolumesFromImageTest-891068580 None] Created volume successfully. Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:30 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:30 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:30 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-0c05d98a-85ff-45d8-b157-607ab0317016-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-0c05d98a-85ff-45d8-b157-607ab0317016-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-quobyte-0c05d98a-85ff-45d8-b157-607ab0317016" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-0c05d98a-85ff-45d8-b157-607ab0317016" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079d845-5e15-44d6-ae0b-e5851af5923b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:31 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 Sep 29 12:51:31 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:31 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:31 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016 Sep 29 12:51:31 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:31 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0c05d98a-85ff-45d8-b157-607ab0317016" returned: 0 in 0.240s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-0c05d98a-85ff-45d8-b157-607ab0317016" released by "delete_volume" :: held 0.646s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Created reservations ['3bd2f72c-6f72-4023-8835-567fbff88cc8', 'c3ed1dc5-675e-4f49-9088-690702f198a0', 'e8668482-ef45-4dda-b752-d3438a53a6e1', 'cc900fde-f010-4a41-8e09-76bb1a6f6e31'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:31 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:31 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:32 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Deleted volume successfully. Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bdd926e1-b3bb-45c1-b4eb-91ad2004b116 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-0c05d98a-85ff-45d8-b157-607ab0317016-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-28c6e380-0ec5-4376-865a-7eabffc5a8a2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-28c6e380-0ec5-4376-865a-7eabffc5a8a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-quobyte-28c6e380-0ec5-4376-865a-7eabffc5a8a2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-28c6e380-0ec5-4376-865a-7eabffc5a8a2" acquired by "delete_volume" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf305129-f5fd-4509-bfb4-4219e8aff5c4]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:32 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 Sep 29 12:51:32 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:32 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2" returned: 0 in 0.359s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:32 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2 Sep 29 12:51:32 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:32 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-28c6e380-0ec5-4376-865a-7eabffc5a8a2" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-28c6e380-0ec5-4376-865a-7eabffc5a8a2" released by "delete_volume" :: held 0.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Created reservations ['96fe0bfd-5468-4dd3-9338-775c7f0fad13', '96f7c0ec-bad6-45fd-a120-48a3bc26aba3', '2f205e66-af9d-4a1b-9067-647ba791e52b', '2150ce33-a4c5-4a55-8fea-80f75c94c024'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:33 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:33 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:33 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.251s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Deleted volume successfully. Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a882101f-1797-4d4b-83e2-d844699977c2 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-28c6e380-0ec5-4376-865a-7eabffc5a8a2-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-307effe5-379f-4fc3-a678-e06d343b68d9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-307effe5-379f-4fc3-a678-e06d343b68d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-quobyte-307effe5-379f-4fc3-a678-e06d343b68d9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-307effe5-379f-4fc3-a678-e06d343b68d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf88790-a828-4c55-9505-82b135615618]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:33 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 Sep 29 12:51:33 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:33 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9" returned: 0 in 0.356s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:33 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9 Sep 29 12:51:33 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:34 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-307effe5-379f-4fc3-a678-e06d343b68d9" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-307effe5-379f-4fc3-a678-e06d343b68d9" released by "delete_volume" :: held 0.649s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Created reservations ['01dc6d7d-cd83-4fc5-9945-605600f616ea', '0ee82d0a-bd55-4c13-9fff-84cb103d1b40', 'b85bdf64-1c20-43c5-b409-98ba8f8b1a09', 'd569fd6f-6589-481e-a4c5-006cc5a0e74c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:34 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:34 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:34 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Deleted volume successfully. Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-652e7a84-60ad-478a-9419-05bf9a70b5e4 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-307effe5-379f-4fc3-a678-e06d343b68d9-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-47398204-3e0d-4053-99d2-94a63773b074-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-47398204-3e0d-4053-99d2-94a63773b074-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-quobyte-47398204-3e0d-4053-99d2-94a63773b074" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-47398204-3e0d-4053-99d2-94a63773b074" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff1e82e-405d-4793-ad6a-8e27dc74542f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:34 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 Sep 29 12:51:34 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:34 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074" returned: 0 in 0.348s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:34 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074 Sep 29 12:51:34 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:35 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-47398204-3e0d-4053-99d2-94a63773b074" returned: 0 in 0.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-47398204-3e0d-4053-99d2-94a63773b074" released by "delete_volume" :: held 0.629s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Created reservations ['a8e0ebe5-a14b-487b-b9ea-d3cc779ca39d', 'b2ec8ad2-408a-4c28-a5fb-592a604b3144', 'b37e734e-2b13-4067-95e4-08848f46f97f', 'd0cfdb7f-dc19-4195-b562-068129e3886f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:35 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:35 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:35 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Deleted volume successfully. Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01b30a1b-9e60-4d39-af12-e026f2b12183 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-47398204-3e0d-4053-99d2-94a63773b074-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-fc5b294d-e1b9-47b4-9420-9e4f65d317e9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-fc5b294d-e1b9-47b4-9420-9e4f65d317e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "cinder-quobyte-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[45208175-e614-459b-8d2c-9665825acb27]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:35 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 Sep 29 12:51:35 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:36 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" returned: 0 in 0.372s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:36 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9 Sep 29 12:51:36 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:36 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-quobyte-fc5b294d-e1b9-47b4-9420-9e4f65d317e9" released by "delete_volume" :: held 0.662s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Created reservations ['7899db9a-70ed-459d-bc7a-197c8e217c6e', '8cd0f9e8-608c-4b74-868f-5d8f9806450b', '79abe362-3d9c-4af7-a478-2cb0e98438ff', '147f0754-92a0-4073-9649-933314a16414'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:36 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:51:36 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:36 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:51:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Deleted volume successfully. Sep 29 12:51:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d87faa4-2552-49a4-9901-44f43f0b9c28 tempest-CreateVolumesFromImageTest-891068580 None] Lock "cinder-fc5b294d-e1b9-47b4-9420-9e4f65d317e9-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:51:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=45,cinder:UPDATE=66,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:51:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=51,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Flow 'volume_create_manager' (dc516eb0-11d0-4ba0-a695-e9016fa43d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69be4f36-e255-4a65-96a6-4884932f304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69be4f36-e255-4a65-96a6-4884932f304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2054340744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261a5bfd-2233-4378-8654-c99e86a03568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d0e90e58a14b98971556460fbe49f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:53Z,use_quota=True,user_id='da8d5d219c2a4081b9417d8f97d83dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70700f-e565-4c37-aced-b0127011ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70700f-e565-4c37-aced-b0127011ef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c197710d-2a96-4eaa-95b5-0dc5156ddeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c197710d-2a96-4eaa-95b5-0dc5156ddeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261a5bfd-2233-4378-8654-c99e86a03568', 'volume_name': 'volume-261a5bfd-2233-4378-8654-c99e86a03568', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5a2872-59c5-413b-b446-f5f34d8af1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5a2872-59c5-413b-b446-f5f34d8af1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138e86bb-a455-4a2c-bab4-85a57687f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Volume 261a5bfd-2233-4378-8654-c99e86a03568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261a5bfd-2233-4378-8654-c99e86a03568', 'volume_size': 1} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2054340744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261a5bfd-2233-4378-8654-c99e86a03568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d0e90e58a14b98971556460fbe49f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:53Z,use_quota=True,user_id='da8d5d219c2a4081b9417d8f97d83dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Creating volume 261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:53 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:53 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 1073741824 Sep 29 12:51:53 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (2bfd31cf-9ec3-466a-a4d0-bedbf6a24a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c344560-4de1-437d-a2ff-e7607e14ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c344560-4de1-437d-a2ff-e7607e14ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387072481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7e11b7-585e-4b98-b250-b4c647b02fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:53Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b5f3b8-5b11-41b4-9f5c-556ab87f40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b5f3b8-5b11-41b4-9f5c-556ab87f40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04d4fb8-ab25-4c00-a5bf-efc60adc16fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04d4fb8-ab25-4c00-a5bf-efc60adc16fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7e11b7-585e-4b98-b250-b4c647b02fdf', 'volume_name': 'volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c8c4d-8595-4fde-aa5e-cbfb82c8bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c8c4d-8595-4fde-aa5e-cbfb82c8bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8564ad-3758-4f2d-95ee-4d3fa14dc5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume dd7e11b7-585e-4b98-b250-b4c647b02fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf', 'volume_size': 1} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (34570b7e-ec7c-47a7-9052-bf59197155c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b126ceef-95e4-48d5-a767-5a55c70237c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b126ceef-95e4-48d5-a767-5a55c70237c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152225746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8d2fe0-c63e-475d-b4cb-edd0275ee38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:54Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2ec58c-c397-4c46-9f9e-c9015bbd36da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2ec58c-c397-4c46-9f9e-c9015bbd36da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75b13a6-a23e-41b6-8bd2-5e1a5204f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75b13a6-a23e-41b6-8bd2-5e1a5204f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8d2fe0-c63e-475d-b4cb-edd0275ee38c', 'volume_name': 'volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b39eb2-ace2-4244-b0e7-3bd479a675f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b39eb2-ace2-4244-b0e7-3bd479a675f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c40da79-e0a0-432a-aa18-1f2a55319438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume 8c8d2fe0-c63e-475d-b4cb-edd0275ee38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c', 'volume_size': 1} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 1073741824" returned: 0 in 0.634s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:53 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:51:53 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:54 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387072481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7e11b7-585e-4b98-b250-b4c647b02fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:53Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume dd7e11b7-585e-4b98-b250-b4c647b02fdf {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138e86bb-a455-4a2c-bab4-85a57687f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261a5bfd-2233-4378-8654-c99e86a03568', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e22244-1171-48e9-82bb-0d2d68773b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:54 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf 1073741824 Sep 29 12:51:54 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Volume volume-261a5bfd-2233-4378-8654-c99e86a03568 (261a5bfd-2233-4378-8654-c99e86a03568): created successfully Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e22244-1171-48e9-82bb-0d2d68773b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Flow 'volume_create_manager' (dc516eb0-11d0-4ba0-a695-e9016fa43d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-884caf80-cde5-48e1-a9f8-46f1e57a2da9 tempest-VolumeDependencyTests-1138669831 None] Created volume successfully. Sep 29 12:51:54 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf 1073741824" returned: 0 in 0.482s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:54 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf Sep 29 12:51:54 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:54 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf" returned: 0 in 0.245s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152225746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8d2fe0-c63e-475d-b4cb-edd0275ee38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:54Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume 8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8564ad-3758-4f2d-95ee-4d3fa14dc5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:54 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c 1073741824 Sep 29 12:51:54 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ea6b5-6662-4201-9436-44ccc2e4dd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf (dd7e11b7-585e-4b98-b250-b4c647b02fdf): created successfully Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ea6b5-6662-4201-9436-44ccc2e4dd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (2bfd31cf-9ec3-466a-a4d0-bedbf6a24a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-53b0cacf-bb58-4192-ab8d-90bb50d54898 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:55 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c 1073741824" returned: 0 in 0.619s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:55 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c Sep 29 12:51:55 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:55 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.454s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Creating offline snapshot eac24cfd-fa95-4065-aee3-3a679df4bfc7 of volume 261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c40da79-e0a0-432a-aa18-1f2a55319438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff42da3-a187-4a45-9941-60be39567f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002c34e-29b5-4f5c-a428-e90bb37ee8ee]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (1ed87c5b-f054-4b7f-9722-3733f28b7ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fdd8a3-a7b6-488a-ba0d-a2ec0026b594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c (8c8d2fe0-c63e-475d-b4cb-edd0275ee38c): created successfully Sep 29 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff42da3-a187-4a45-9941-60be39567f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (34570b7e-ec7c-47a7-9052-bf59197155c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fdd8a3-a7b6-488a-ba0d-a2ec0026b594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922520761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf21cccc-2104-414e-ae64-b30924ce5c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:56Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9c91bb-e818-4461-ab99-2a2d37e7b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9c91bb-e818-4461-ab99-2a2d37e7b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52adb66-7cc5-4a3c-9173-fba6dbb8ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52adb66-7cc5-4a3c-9173-fba6dbb8ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf21cccc-2104-414e-ae64-b30924ce5c5f', 'volume_name': 'volume-cf21cccc-2104-414e-ae64-b30924ce5c5f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:51:56 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6630e286-c461-4447-b18a-5aaff77df18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6630e286-c461-4447-b18a-5aaff77df18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bfa8bf-1fc2-4512-8125-3f28f553897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume cf21cccc-2104-414e-ae64-b30924ce5c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf21cccc-2104-414e-ae64-b30924ce5c5f', 'volume_size': 1} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dcbda7bf-a8b3-4a8e-8662-b5c8f96cebaa tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (3627edaf-7b7b-4d10-8c63-a661661b7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c192b3-2af2-45b6-a7e4-92bd926d3258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c192b3-2af2-45b6-a7e4-92bd926d3258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814021872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a809056-ed63-4517-9e32-2a434a6692d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:56Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3154b0ef-34d8-4479-b7b7-4aae496fb336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3154b0ef-34d8-4479-b7b7-4aae496fb336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53db063a-074b-4270-9434-b753f6998894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53db063a-074b-4270-9434-b753f6998894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a809056-ed63-4517-9e32-2a434a6692d4', 'volume_name': 'volume-7a809056-ed63-4517-9e32-2a434a6692d4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de315887-e2d0-409c-af8e-aaeb047dd987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de315887-e2d0-409c-af8e-aaeb047dd987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243b34ab-d4bc-4bfd-ac1c-8370bf7ece4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume 7a809056-ed63-4517-9e32-2a434a6692d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a809056-ed63-4517-9e32-2a434a6692d4', 'volume_size': 1} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.488s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:56 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 1G Sep 29 12:51:56 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (2d1a83a6-e798-4738-b0fe-365a930225ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003b304a-6b84-4909-9302-061b94c81881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003b304a-6b84-4909-9302-061b94c81881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334033867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc4bf46-715c-46b8-a508-f6ec0dd137ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:57Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e15bb6-a6bf-4069-b17f-177b48ad9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e15bb6-a6bf-4069-b17f-177b48ad9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a57bbbd-effd-4156-81eb-b936a25a2a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a57bbbd-effd-4156-81eb-b936a25a2a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc4bf46-715c-46b8-a508-f6ec0dd137ab', 'volume_name': 'volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa82542-d6b1-42ff-aeb4-42b884104d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa82542-d6b1-42ff-aeb4-42b884104d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa10b6e-817c-4b0b-91c2-031a53051500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume 6bc4bf46-715c-46b8-a508-f6ec0dd137ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab', 'volume_size': 1} Sep 29 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:57 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 1G" returned: 0 in 0.591s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261a5bfd-2233-4378-8654-c99e86a03568 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:57 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261a5bfd-2233-4378-8654-c99e86a03568 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:51:57 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (f722ec0f-60f2-44e8-9011-0a1fd3ac318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2b0fb6-811a-4924-bc63-bdb174bbab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2b0fb6-811a-4924-bc63-bdb174bbab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844147978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b588062-3e18-4d6e-bd8a-330181847807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:57Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc8762c-fcc6-48f7-95bd-c5d3a6fef677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc8762c-fcc6-48f7-95bd-c5d3a6fef677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf2ba05-e22a-4856-b739-8e78ed984763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf2ba05-e22a-4856-b739-8e78ed984763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b588062-3e18-4d6e-bd8a-330181847807', 'volume_name': 'volume-1b588062-3e18-4d6e-bd8a-330181847807', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82779582-8253-41e7-9640-2c93544979a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82779582-8253-41e7-9640-2c93544979a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab32e88-e4c8-41ca-a80b-ced68910f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume 1b588062-3e18-4d6e-bd8a-330181847807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b588062-3e18-4d6e-bd8a-330181847807', 'volume_size': 1} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:57 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261a5bfd-2233-4378-8654-c99e86a03568 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 is being set with open permissions: ugo+rw Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:57 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:51:57 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Flow 'volume_create_manager' (9042ba86-ea33-4ee1-9a0c-1ab1bed04ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0a8ef4-2df6-4236-bbf5-de608c540a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0a8ef4-2df6-4236-bbf5-de608c540a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487f3565-492a-4e25-8e08-dc5e61d98d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1cbe76356ad4fc7ada05c39e496c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:58Z,use_quota=True,user_id='67412afb9c994c4ca66afc333738934c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86077507-2911-45e1-be9d-4322180f1c39),volume_type_id=86077507-2911-45e1-be9d-4322180f1c39)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f8272e-96fe-407d-947b-f9778c239770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f8272e-96fe-407d-947b-f9778c239770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdeab7b2-556d-4e00-a401-ad23a90635b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:51:57 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.302s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (7f1bd45c-8311-42f6-bf92-100b59e5ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13caf5c2-b405-4198-9ac2-03aca86c04ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13caf5c2-b405-4198-9ac2-03aca86c04ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602781351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd960a2-46e7-4e4b-bb0e-8370ecbfe889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:58Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff89e7e-ac77-475c-b3b0-7e2ae356b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff89e7e-ac77-475c-b3b0-7e2ae356b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497808dd-f7ae-4a7d-bdf9-832978f9ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497808dd-f7ae-4a7d-bdf9-832978f9ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd960a2-46e7-4e4b-bb0e-8370ecbfe889', 'volume_name': 'volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331730a5-a6e2-402f-90e2-6ac5cc51834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331730a5-a6e2-402f-90e2-6ac5cc51834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b580e2-b01e-46cd-afb4-4fd1d5da5067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume 3dd960a2-46e7-4e4b-bb0e-8370ecbfe889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889', 'volume_size': 1} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:58 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info Sep 29 12:51:58 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdeab7b2-556d-4e00-a401-ad23a90635b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '487f3565-492a-4e25-8e08-dc5e61d98d25', 'volume_name': 'volume-487f3565-492a-4e25-8e08-dc5e61d98d25', 'volume_size': 1, 'image_id': '52703175-2a3f-492f-8d64-c7b899cef783', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b1b7833054ae73623136197446bf94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1cbe76356ad4fc7ada05c39e496c373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2113b75cb5025f9a5c3b29d826027f541f317f107e87c15641602ea2f01b129a097ae6440ac3454e8315e3cc692f754a839b10bef937ea92600d7dca6594f37', 'id': '52703175-2a3f-492f-8d64-c7b899cef783', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52703175-2a3f-492f-8d64-c7b899cef783/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edab9e6-2fdc-4ff3-ae82-5037d34a3f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edab9e6-2fdc-4ff3-ae82-5037d34a3f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc3db63-32de-439a-998e-530581cdd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Volume 487f3565-492a-4e25-8e08-dc5e61d98d25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-487f3565-492a-4e25-8e08-dc5e61d98d25', 'volume_size': 1, 'image_id': '52703175-2a3f-492f-8d64-c7b899cef783', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b1b7833054ae73623136197446bf94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1cbe76356ad4fc7ada05c39e496c373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2113b75cb5025f9a5c3b29d826027f541f317f107e87c15641602ea2f01b129a097ae6440ac3454e8315e3cc692f754a839b10bef937ea92600d7dca6594f37', 'id': '52703175-2a3f-492f-8d64-c7b899cef783', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52703175-2a3f-492f-8d64-c7b899cef783/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Trying to clone 487f3565-492a-4e25-8e08-dc5e61d98d25 from image 52703175-2a3f-492f-8d64-c7b899cef783 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:51:58 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b415161b-46d3-4028-8d64-fb742d3f54bb]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:58 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info" returned: 0 in 0.245s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:58 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info is being set with open permissions: ugo+rw Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:58 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info Sep 29 12:51:58 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:58 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:51:58 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:58 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.info" returned: 0 in 0.273s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922520761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf21cccc-2104-414e-ae64-b30924ce5c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:56Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume cf21cccc-2104-414e-ae64-b30924ce5c5f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:58 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:58 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:58 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f 1073741824 Sep 29 12:51:58 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5f817e36-aa8e-4204-a2cc-0a19b1852f3f tempest-VolumeDependencyTests-1138669831 None] Create snapshot completed successfully Sep 29 12:51:58 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:51:58 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:58 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Temporary image 52703175-2a3f-492f-8d64-c7b899cef783 is fetched for user 67412afb9c994c4ca66afc333738934c. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce33a04-bf97-4777-b072-afb84e2a89d6]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:51:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:59 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f 1073741824" returned: 0 in 0.488s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:59 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f Sep 29 12:51:59 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:59 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:51:59 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Flow 'volume_create_manager' (f77b14e5-3742-4785-9876-ba89b91d93a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fafb06d-6152-4af5-8904-2c1724ce203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:59 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fafb06d-6152-4af5-8904-2c1724ce203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-991040198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f712d-eaef-4009-b515-46bdff48d9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d0e90e58a14b98971556460fbe49f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eac24cfd-fa95-4065-aee3-3a679df4bfc7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:59Z,use_quota=True,user_id='da8d5d219c2a4081b9417d8f97d83dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b415a76-15bc-41d3-a59a-b33ee53f7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b415a76-15bc-41d3-a59a-b33ee53f7426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79c5fad-6bad-4e73-9112-0fab8a276744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79c5fad-6bad-4e73-9112-0fab8a276744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f13f712d-eaef-4009-b515-46bdff48d9aa', 'volume_name': 'volume-f13f712d-eaef-4009-b515-46bdff48d9aa', 'volume_size': 1, 'snapshot_id': 'eac24cfd-fa95-4065-aee3-3a679df4bfc7'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488634ce-c81a-4aca-bf6d-cbdb038c7e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488634ce-c81a-4aca-bf6d-cbdb038c7e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3070b-f85e-45d1-8022-749302fec975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Volume f13f712d-eaef-4009-b515-46bdff48d9aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f13f712d-eaef-4009-b515-46bdff48d9aa', 'volume_size': 1, 'snapshot_id': 'eac24cfd-fa95-4065-aee3-3a679df4bfc7'} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f" returned: 0 in 0.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.975s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814021872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a809056-ed63-4517-9e32-2a434a6692d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:56Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume 7a809056-ed63-4517-9e32-2a434a6692d4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:51:59 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bfa8bf-1fc2-4512-8125-3f28f553897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf21cccc-2104-414e-ae64-b30924ce5c5f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 1073741824 Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ccaf45-cba5-45f7-a125-2b94bb24619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:51:59 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-cf21cccc-2104-414e-ae64-b30924ce5c5f (cf21cccc-2104-414e-ae64-b30924ce5c5f): created successfully Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ccaf45-cba5-45f7-a125-2b94bb24619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (1ed87c5b-f054-4b7f-9722-3733f28b7ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:51:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8d5e7111-0833-4a5c-90ed-c492c02dbcda tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:51:59 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:51:59 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:51:59 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:51:59 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 1073741824" returned: 0 in 0.462s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:51:59 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 Sep 29 12:51:59 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:00 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4" returned: 0 in 0.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.322s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334033867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc4bf46-715c-46b8-a508-f6ec0dd137ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:57Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume 6bc4bf46-715c-46b8-a508-f6ec0dd137ab {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243b34ab-d4bc-4bfd-ac1c-8370bf7ece4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a809056-ed63-4517-9e32-2a434a6692d4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5190c8c3-b8d1-4298-86fe-e2541a4f8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:00 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab 1073741824 Sep 29 12:52:00 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-7a809056-ed63-4517-9e32-2a434a6692d4 (7a809056-ed63-4517-9e32-2a434a6692d4): created successfully Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5190c8c3-b8d1-4298-86fe-e2541a4f8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (3627edaf-7b7b-4d10-8c63-a661661b7a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3ca557fb-20b0-455d-872c-d3989a570a12 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:52:00 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab 1073741824" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:00 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab Sep 29 12:52:00 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:00 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.479s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844147978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b588062-3e18-4d6e-bd8a-330181847807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:57Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume 1b588062-3e18-4d6e-bd8a-330181847807 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa10b6e-817c-4b0b-91c2-031a53051500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:00 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 1073741824 Sep 29 12:52:00 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1114e78b-99d5-4bff-a103-33f45dd7e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab (6bc4bf46-715c-46b8-a508-f6ec0dd137ab): created successfully Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1114e78b-99d5-4bff-a103-33f45dd7e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (2d1a83a6-e798-4738-b0fe-365a930225ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b51822ad-3557-464b-a240-8dc7de186915 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:52:01 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 1073741824" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:01 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 Sep 29 12:52:01 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:01 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807" returned: 0 in 0.242s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.933s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab32e88-e4c8-41ca-a80b-ced68910f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b588062-3e18-4d6e-bd8a-330181847807', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d060c4c-eef8-49a0-a345-12ef32276a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating offline snapshot 3192745f-fa52-4e9b-bd57-8b856f55e1bf of volume 8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:52:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-1b588062-3e18-4d6e-bd8a-330181847807 (1b588062-3e18-4d6e-bd8a-330181847807): created successfully Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d060c4c-eef8-49a0-a345-12ef32276a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (f722ec0f-60f2-44e8-9011-0a1fd3ac318b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5ac15-e5b1-46df-b158-77f658c9d629]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-92d9db4f-a0e6-41df-87be-c052d0b57167 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:52:01 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c Sep 29 12:52:01 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:02 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:02 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf 1G Sep 29 12:52:02 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:02 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf 1G" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:02 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf Sep 29 12:52:02 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:02 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf" returned: 0 in 0.316s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:02 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf is being set with open permissions: ugo+rw Sep 29 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:02 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf Sep 29 12:52:02 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:03 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:03 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info Sep 29 12:52:03 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:03 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info" returned: 0 in 0.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info is being set with open permissions: ugo+rw Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:03 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info Sep 29 12:52:03 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:03 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.info" returned: 0 in 0.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.742s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602781351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd960a2-46e7-4e4b-bb0e-8370ecbfe889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7ab02a8f704b80b2e471372b4fd7c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:58Z,use_quota=True,user_id='514e77ec4ad2454ca47b013a8cef0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Creating volume 3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:03 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 1073741824 Sep 29 12:52:03 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e95bf7fc-9381-4bd0-944e-041d0a2252b6 tempest-CreateVolumesFromSnapshotTest-149306426 None] Create snapshot completed successfully Sep 29 12:52:04 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 1073741824" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:04 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 Sep 29 12:52:04 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:04 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7-f13f712d-eaef-4009-b515-46bdff48d9aa" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b580e2-b01e-46cd-afb4-4fd1d5da5067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76a2239-95fe-47dd-b3ac-1b9d6a5ec408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7-f13f712d-eaef-4009-b515-46bdff48d9aa" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Creating volume f13f712d-eaef-4009-b515-46bdff48d9aa from snapshot eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Volume volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 (3dd960a2-46e7-4e4b-bb0e-8370ecbfe889): created successfully Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76a2239-95fe-47dd-b3ac-1b9d6a5ec408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Flow 'volume_create_manager' (7f1bd45c-8311-42f6-bf92-100b59e5ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] snapshot: eac24cfd-fa95-4065-aee3-3a679df4bfc7, volume: f13f712d-eaef-4009-b515-46bdff48d9aa, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:52:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eb8126cf-741c-49e9-b33e-021903180f0c tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created volume successfully. Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd5cfc-bfe4-4962-8cdf-4db36568e5c0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:04 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:52:04 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:04 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.381s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261a5bfd-2233-4378-8654-c99e86a03568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[426dea3e-2387-4283-bd0b-31c975a8c281]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:05 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:52:05 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (e88007b7-e784-4f1c-ab3e-cc7d7bf6c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41667e66-ebfb-43e6-80d8-301ac9087573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41667e66-ebfb-43e6-80d8-301ac9087573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862755692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d470e8d-8b10-4de1-b3b3-0b6a98f199e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:05Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4147df-6353-4158-8a25-94de26ed98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4147df-6353-4158-8a25-94de26ed98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79265ddb-a23f-4f53-b460-c794144b8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79265ddb-a23f-4f53-b460-c794144b8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d470e8d-8b10-4de1-b3b3-0b6a98f199e2', 'volume_name': 'volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a2b29c-2d57-490e-9905-8159103e049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a2b29c-2d57-490e-9905-8159103e049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b012425-ad4b-48da-b763-e98c317598cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume 3d470e8d-8b10-4de1-b3b3-0b6a98f199e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2', 'volume_size': 1} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:05 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:05 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa Sep 29 12:52:05 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5d6aa4-d05b-4d4e-be38-a377045b9514]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (95a8d8e7-15f4-48da-b019-f70449248818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf489a86-5178-48fc-a6a4-4744a2d9dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf489a86-5178-48fc-a6a4-4744a2d9dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113409869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca448049-51f8-4692-8f9c-07cf439205f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:06Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f56163-3d9e-4f6f-ae02-125c69ef2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 Sep 29 12:52:05 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f56163-3d9e-4f6f-ae02-125c69ef2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd2bb5-d39e-465d-92f0-08bec30003db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd2bb5-d39e-465d-92f0-08bec30003db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca448049-51f8-4692-8f9c-07cf439205f1', 'volume_name': 'volume-ca448049-51f8-4692-8f9c-07cf439205f1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2179c73-bdc5-4ba5-a0e4-5ac0aeb20a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2179c73-bdc5-4ba5-a0e4-5ac0aeb20a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a315d27a-4dd0-480e-b222-877e661838a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume ca448049-51f8-4692-8f9c-07cf439205f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca448049-51f8-4692-8f9c-07cf439205f1', 'volume_size': 1} Sep 29 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:06 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" returned: 0 in 0.569s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:06 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889 Sep 29 12:52:06 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (cff74243-cc72-4ffb-a827-8df888eb4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229294f3-2536-45fa-9bf8-d39bfd82131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229294f3-2536-45fa-9bf8-d39bfd82131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288425385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db1eb38-08d1-4591-a2f1-e233a661fb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:06Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf3d5d9-9cf2-40dd-9e91-022a165c1540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf3d5d9-9cf2-40dd-9e91-022a165c1540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05524424-e50f-42fd-987c-23d0fc0e602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05524424-e50f-42fd-987c-23d0fc0e602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db1eb38-08d1-4591-a2f1-e233a661fb7f', 'volume_name': 'volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b689a474-8148-4929-8bcd-c46ee04e69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b689a474-8148-4929-8bcd-c46ee04e69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abba98ad-f21a-492d-9942-71868d54d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume 8db1eb38-08d1-4591-a2f1-e233a661fb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f', 'volume_size': 1} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:06 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" returned: 0 in 0.680s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889" released by "delete_volume" :: held 1.344s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (c914bae6-7e51-4685-b71d-d038addc7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95229d55-1490-4170-8d9a-2bf3894a9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95229d55-1490-4170-8d9a-2bf3894a9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410007088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e3a6c7-1de3-4f75-b91a-eeed7a05b276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:07Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c078dc-0801-4f74-bdd3-30d0068c5dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c078dc-0801-4f74-bdd3-30d0068c5dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0019d77e-d46e-4788-a95e-6372dd50d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0019d77e-d46e-4788-a95e-6372dd50d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e3a6c7-1de3-4f75-b91a-eeed7a05b276', 'volume_name': 'volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16915a49-06df-4366-94d9-3903632a878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16915a49-06df-4366-94d9-3903632a878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062c4ba3-345b-4178-ac3a-0cfe6fa47f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume 39e3a6c7-1de3-4f75-b91a-eeed7a05b276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276', 'volume_size': 1} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['559aaf91-3398-4617-a4f3-33ba9fb85bd6', '463d2e97-000f-4d09-a31a-06bac78f911c', '5000cefc-a2bc-40b2-8f2e-4fc3e8b4433b', '53165978-cd65-4471-8097-f92a67316aa4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:07 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:07 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (ed9bbb58-788d-407c-ae77-f142ad7f79f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcfb01d-c3b8-4413-a355-6d71dbfd97f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcfb01d-c3b8-4413-a355-6d71dbfd97f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604908027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fa294e-b916-4563-9852-767354a6c3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:08Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd6b5cb-9087-4335-9263-a3c2a239dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd6b5cb-9087-4335-9263-a3c2a239dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10594f0a-8043-455a-8934-6dd872f4929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10594f0a-8043-455a-8934-6dd872f4929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fa294e-b916-4563-9852-767354a6c3e9', 'volume_name': 'volume-38fa294e-b916-4563-9852-767354a6c3e9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66ebb23-fb1c-4693-988f-9fecb84c8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66ebb23-fb1c-4693-988f-9fecb84c8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:07 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733daf95-32f1-4b8f-8b22-f92dd5d93de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume 38fa294e-b916-4563-9852-767354a6c3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fa294e-b916-4563-9852-767354a6c3e9', 'volume_size': 1} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd18a19c-b32b-49cf-af45-7e44f1add8c4 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-3dd960a2-46e7-4e4b-bb0e-8370ecbfe889-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-1b588062-3e18-4d6e-bd8a-330181847807-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-1b588062-3e18-4d6e-bd8a-330181847807-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-1b588062-3e18-4d6e-bd8a-330181847807" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-1b588062-3e18-4d6e-bd8a-330181847807" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d8782e-43c3-40d9-89a0-5975bd8137ed]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:08 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 Sep 29 12:52:08 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:08 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807" returned: 0 in 0.547s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:08 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807 Sep 29 12:52:08 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:09 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1b588062-3e18-4d6e-bd8a-330181847807" returned: 0 in 0.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-1b588062-3e18-4d6e-bd8a-330181847807" released by "delete_volume" :: held 1.096s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['90bf5317-9289-49ed-9f67-f1fcdc573df5', '88165968-9a4d-434d-9237-a5684940fcf1', 'a9740126-476e-4ac7-aa1f-bccd9f92fd71', 'bee5fb16-46c1-4834-b867-509463adf77f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:09 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:09 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:09 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6596e72c-e2b9-44f3-9ecc-464e63c4e1bc tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-1b588062-3e18-4d6e-bd8a-330181847807-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-6bc4bf46-715c-46b8-a508-f6ec0dd137ab-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-6bc4bf46-715c-46b8-a508-f6ec0dd137ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ab43a-2f92-4f80-95d7-01553f35f02f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:10 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab Sep 29 12:52:10 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:11 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" returned: 0 in 0.639s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:11 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab Sep 29 12:52:11 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:11 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" returned: 0 in 0.352s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-6bc4bf46-715c-46b8-a508-f6ec0dd137ab" released by "delete_volume" :: held 1.094s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['ef298107-0526-4a64-8f0e-ea8b64be1400', '4cf127ea-eff8-4b66-bc2b-fcb60eff5883', 'a6c92ea9-8c49-4f3a-bf53-7a8342c7c3e8', 'ee9a39c9-09f6-4fc8-b8e1-e4ebdf868d30'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:11 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:11 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:12 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b0c180de-5c06-4bb0-91cc-c28c61484edd tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-6bc4bf46-715c-46b8-a508-f6ec0dd137ab-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-7a809056-ed63-4517-9e32-2a434a6692d4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-7a809056-ed63-4517-9e32-2a434a6692d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-7a809056-ed63-4517-9e32-2a434a6692d4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-7a809056-ed63-4517-9e32-2a434a6692d4" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9c25b-cc53-44a6-b94a-7f6eca28baae]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:12 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa" returned: 0 in 7.580s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:52:12 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Converted 1024.00 MB image at 135.06 MB/s Sep 29 12:52:12 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa is being set with open permissions: ugo+rw Sep 29 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:13 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa Sep 29 12:52:13 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 Sep 29 12:52:13 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" released by "_copy_volume_from_snapshot" :: held 8.726s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7-f13f712d-eaef-4009-b515-46bdff48d9aa" released by "_create_volume_from_snapshot" :: held 8.811s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.849s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.568s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487f3565-492a-4e25-8e08-dc5e61d98d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1cbe76356ad4fc7ada05c39e496c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:51:58Z,use_quota=True,user_id='67412afb9c994c4ca66afc333738934c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86077507-2911-45e1-be9d-4322180f1c39),volume_type_id=86077507-2911-45e1-be9d-4322180f1c39)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Creating volume 487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:13 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:13 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4" returned: 0 in 0.407s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:13 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1073741824 Sep 29 12:52:13 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4 Sep 29 12:52:13 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3070b-f85e-45d1-8022-749302fec975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13f712d-eaef-4009-b515-46bdff48d9aa', 'volume_size': 1, 'snapshot_id': 'eac24cfd-fa95-4065-aee3-3a679df4bfc7'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db55b0b-bbe1-452c-8a8d-a6953dde7325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Volume volume-f13f712d-eaef-4009-b515-46bdff48d9aa (f13f712d-eaef-4009-b515-46bdff48d9aa): created successfully Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db55b0b-bbe1-452c-8a8d-a6953dde7325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Flow 'volume_create_manager' (f77b14e5-3742-4785-9876-ba89b91d93a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9f3d5978-7dbf-4629-abba-8503ba28a692 tempest-VolumeDependencyTests-1138669831 None] Created volume successfully. Sep 29 12:52:13 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-7a809056-ed63-4517-9e32-2a434a6692d4" returned: 0 in 0.235s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-7a809056-ed63-4517-9e32-2a434a6692d4" released by "delete_volume" :: held 0.726s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['67167952-1786-41ba-ae2d-434f95f2dcb2', '7c807cec-e687-4956-8b1b-0daab75197f8', 'e38f95bc-2539-419a-970b-2a036c67f57f', '5e6bd98b-7735-47c8-9df0-fdd7626c6fe6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:13 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:13 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1073741824" returned: 0 in 0.490s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:13 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 Sep 29 12:52:13 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:13 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-cf21cccc-2104-414e-ae64-b30924ce5c5f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:13 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-cf21cccc-2104-414e-ae64-b30924ce5c5f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a88cdc82-7c0e-4311-a179-42a253bdb086 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-7a809056-ed63-4517-9e32-2a434a6692d4-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-cf21cccc-2104-414e-ae64-b30924ce5c5f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-cf21cccc-2104-414e-ae64-b30924ce5c5f" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83cd46-d654-4530-b9b0-ab049d3cf362]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:14 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.788s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862755692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d470e8d-8b10-4de1-b3b3-0b6a98f199e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:05Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume 3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:14 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 1073741824 Sep 29 12:52:14 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Attempting download of 52703175-2a3f-492f-8d64-c7b899cef783 ((None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}])) to volume 487f3565-492a-4e25-8e08-dc5e61d98d25. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4003d7-0490-42f0-a365-1a95da90cb07]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f Sep 29 12:52:14 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y Sep 29 12:52:14 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-eac24cfd-fa95-4065-aee3-3a679df4bfc7-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-eac24cfd-fa95-4065-aee3-3a679df4bfc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:14 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f" returned: 0 in 0.468s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:14 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f Sep 29 12:52:14 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Deleting offline snapshot eac24cfd-fa95-4065-aee3-3a679df4bfc7 of volume 261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] snapshot_file for this snap is: volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[40993acd-2282-49e3-b28d-9d1046cdb0f1]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y Sep 29 12:52:14 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 1073741824" returned: 0 in 0.591s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:14 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 Sep 29 12:52:14 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:52:14 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:14 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cf21cccc-2104-414e-ae64-b30924ce5c5f" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-cf21cccc-2104-414e-ae64-b30924ce5c5f" released by "delete_volume" :: held 0.806s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['a6920802-d898-4217-81ac-b2fe9909a2cb', 'a412df4e-26e3-45cd-88dc-44d81ecc8a9f', '369e0572-5aa3-4183-bbcb-0b633e12ff8e', '033458fa-2099-4489-a2f7-246da477a1be'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:14 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y" returned: 1 in 0.344s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52703175-2a3f-492f-8d64-c7b899cef783_z7vg528y' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d20ed1a-6f50-4225-b0cc-f1db2e46cc14]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:15 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:52:15 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.348s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113409869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca448049-51f8-4692-8f9c-07cf439205f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:06Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume ca448049-51f8-4692-8f9c-07cf439205f1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.523s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261a5bfd-2233-4378-8654-c99e86a03568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:15 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 1073741824 Sep 29 12:52:15 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-dd7e11b7-585e-4b98-b250-b4c647b02fdf-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b012425-ad4b-48da-b763-e98c317598cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726a03be-2596-4e1b-b1d2-29b63dc6d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d886c6b-8e36-4c4b-b668-e4abb18ff28b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-dd7e11b7-585e-4b98-b250-b4c647b02fdf-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 (3d470e8d-8b10-4de1-b3b3-0b6a98f199e2): created successfully Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726a03be-2596-4e1b-b1d2-29b63dc6d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (e88007b7-e784-4f1c-ab3e-cc7d7bf6c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:15 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.360s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4434bc5e-8721-464b-ad78-052690e7ff63 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:15 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:52:15 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "cinder-quobyte-dd7e11b7-585e-4b98-b250-b4c647b02fdf" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee0933a4-3404-4c0f-9dd3-f9f525a7b36b tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-cf21cccc-2104-414e-ae64-b30924ce5c5f-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-dd7e11b7-585e-4b98-b250-b4c647b02fdf" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32603e-4341-4cea-8c1e-07c84171d3bf]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf Sep 29 12:52:15 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD Sep 29 12:52:15 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 1073741824" returned: 0 in 0.542s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 Sep 29 12:52:15 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.616s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf" returned: 0 in 0.428s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:15 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:52:15 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] 52703175-2a3f-492f-8d64-c7b899cef783 was raw, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:15 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf Sep 29 12:52:15 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:15 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 Sep 29 12:52:15 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1" returned: 0 in 0.316s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.423s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288425385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db1eb38-08d1-4591-a2f1-e233a661fb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:06Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume 8db1eb38-08d1-4591-a2f1-e233a661fb7f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a315d27a-4dd0-480e-b222-877e661838a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca448049-51f8-4692-8f9c-07cf439205f1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3684ec3a-d0d9-4645-ae33-30e365e72a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:16 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f 1073741824 Sep 29 12:52:16 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-ca448049-51f8-4692-8f9c-07cf439205f1 (ca448049-51f8-4692-8f9c-07cf439205f1): created successfully Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3684ec3a-d0d9-4645-ae33-30e365e72a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (95a8d8e7-15f4-48da-b019-f70449248818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:16 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-dd7e11b7-585e-4b98-b250-b4c647b02fdf" returned: 0 in 0.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bdde7fab-f215-4380-bb8b-081deba4ef95 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-quobyte-dd7e11b7-585e-4b98-b250-b4c647b02fdf" released by "delete_volume" :: held 0.762s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Created reservations ['d7c1d26e-8208-4905-bca9-b35bbf19a136', '11a9f563-757e-4ce2-a296-379bd6ae49ce', 'bce82f1b-e73c-4896-96a6-102ebc8a02be', '4ed7ffa4-0101-492b-930e-5d6018f28d8f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:16 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.500s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:16 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:16 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7 Sep 29 12:52:16 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25" returned: 0 in 0.601s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52703175-2a3f-492f-8d64-c7b899cef783_b402kpegdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:16 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1G Sep 29 12:52:16 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.300s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Deleted volume successfully. Sep 29 12:52:16 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568.eac24cfd-fa95-4065-aee3-3a679df4bfc7" returned: 0 in 0.311s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d40e410d-9462-40f3-be90-24cc2797d516 tempest-CreateVolumesFromSourceVolumeTest-894874346 None] Lock "cinder-dd7e11b7-585e-4b98-b250-b4c647b02fdf-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f 1073741824" returned: 0 in 0.633s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-eac24cfd-fa95-4065-aee3-3a679df4bfc7" released by "_delete_snapshot" :: held 2.142s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" released by "delete_snapshot" :: held 2.191s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:16 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f Sep 29 12:52:16 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Created reservations ['e1d83d60-40e2-4c0b-887e-51c4fc705294', '8818f503-7d12-4538-9aeb-264871c04dd4', '390454bb-3957-4546-84ce-acc1091147e4', '99af98c6-576e-4988-8f8c-325cb90d7ad4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:16 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 1G" returned: 0 in 0.387s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Downloaded image 52703175-2a3f-492f-8d64-c7b899cef783 ((None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}])) to volume 487f3565-492a-4e25-8e08-dc5e61d98d25 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Temporary image 52703175-2a3f-492f-8d64-c7b899cef783 for user 67412afb9c994c4ca66afc333738934c is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Marking volume 487f3565-492a-4e25-8e08-dc5e61d98d25 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:52:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Delete snapshot completed successfully. Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-baca4a72-7080-4d1b-b914-593f306ba33d tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-eac24cfd-fa95-4065-aee3-3a679df4bfc7-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Copying metadata from image 52703175-2a3f-492f-8d64-c7b899cef783 to 487f3565-492a-4e25-8e08-dc5e61d98d25. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:52:16 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Creating volume glance metadata for volume 487f3565-492a-4e25-8e08-dc5e61d98d25 backed by image 52703175-2a3f-492f-8d64-c7b899cef783 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '52703175-2a3f-492f-8d64-c7b899cef783', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2b1b7833054ae73623136197446bf94', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc3db63-32de-439a-998e-530581cdd149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487f3565-492a-4e25-8e08-dc5e61d98d25', 'volume_size': 1, 'image_id': '52703175-2a3f-492f-8d64-c7b899cef783', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52703175-2a3f-492f-8d64-c7b899cef783', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b1b7833054ae73623136197446bf94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1cbe76356ad4fc7ada05c39e496c373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2113b75cb5025f9a5c3b29d826027f541f317f107e87c15641602ea2f01b129a097ae6440ac3454e8315e3cc692f754a839b10bef937ea92600d7dca6594f37', 'id': '52703175-2a3f-492f-8d64-c7b899cef783', 'created_at': datetime.datetime(2026, 9, 29, 10, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 51, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52703175-2a3f-492f-8d64-c7b899cef783/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f20e4-5c5c-48b3-a67d-0dc5430d539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Volume volume-487f3565-492a-4e25-8e08-dc5e61d98d25 (487f3565-492a-4e25-8e08-dc5e61d98d25): created successfully Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f20e4-5c5c-48b3-a67d-0dc5430d539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Flow 'volume_create_manager' (9042ba86-ea33-4ee1-9a0c-1ab1bed04ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:17 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.955s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410007088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e3a6c7-1de3-4f75-b91a-eeed7a05b276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:07Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume 39e3a6c7-1de3-4f75-b91a-eeed7a05b276 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-611df906-c5e7-431a-92db-0998aaf3c2c8 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Created volume successfully. Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abba98ad-f21a-492d-9942-71868d54d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:17 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 1073741824 Sep 29 12:52:17 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf562e4-f548-4186-b81f-a69f52d4cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f (8db1eb38-08d1-4591-a2f1-e233a661fb7f): created successfully Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf562e4-f548-4186-b81f-a69f52d4cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (cff74243-cc72-4ffb-a827-8df888eb4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-19f4f481-36a8-4372-8c83-0b17761691cb tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:52:17 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 1073741824" returned: 0 in 0.440s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:17 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 Sep 29 12:52:17 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-261a5bfd-2233-4378-8654-c99e86a03568-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-261a5bfd-2233-4378-8654-c99e86a03568-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:17 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.134s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604908027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fa294e-b916-4563-9852-767354a6c3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6dec11684f4c7598495400faceaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:08Z,use_quota=True,user_id='371a608a9676400f94d41775c41c134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Creating volume 38fa294e-b916-4563-9852-767354a6c3e9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1bdbc-174f-4fb9-8e00-f8fdfeb935b7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:17 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 1073741824 Sep 29 12:52:17 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062c4ba3-345b-4178-ac3a-0cfe6fa47f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dec80ba-8f4b-4d11-98e8-6340d9d11385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 (39e3a6c7-1de3-4f75-b91a-eeed7a05b276): created successfully Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dec80ba-8f4b-4d11-98e8-6340d9d11385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (c914bae6-7e51-4685-b71d-d038addc7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:18 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:52:18 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-65a85aa5-c44d-4dfe-adbc-a9ac8e639606 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Acquiring lock "cinder-487f3565-492a-4e25-8e08-dc5e61d98d25-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "cinder-487f3565-492a-4e25-8e08-dc5e61d98d25-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Acquiring lock "cinder-quobyte-487f3565-492a-4e25-8e08-dc5e61d98d25" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "cinder-quobyte-487f3565-492a-4e25-8e08-dc5e61d98d25" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a82a3-731e-423d-ba8b-e8f0cf0cdeed]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:18 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 Sep 29 12:52:18 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.503s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:18 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568 Sep 29 12:52:18 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 1073741824" returned: 0 in 0.792s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:18 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25" returned: 0 in 0.555s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:18 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-261a5bfd-2233-4378-8654-c99e86a03568" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:18 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25 Sep 29 12:52:18 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-261a5bfd-2233-4378-8654-c99e86a03568" released by "delete_volume" :: held 1.000s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:18 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 Sep 29 12:52:18 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Created reservations ['c2a67866-7fbf-4b5c-990f-427b3451be01', '7bb12f54-9c1e-4c57-8183-1d1c91f57a1a', 'ad221882-4051-42b3-a64f-3461295b6932', 'af7e4eb8-7c70-471e-a32a-ec893128b757'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:19 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:19 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:19 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-487f3565-492a-4e25-8e08-dc5e61d98d25" returned: 0 in 0.334s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "cinder-quobyte-487f3565-492a-4e25-8e08-dc5e61d98d25" released by "delete_volume" :: held 0.962s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:19 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9" returned: 0 in 0.352s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Created reservations ['d1fa1ca6-258d-44ad-a9aa-53069542deb3', '62c2db00-5dae-49f0-b6d0-9c1828c2f134', '22d360b8-b122-4668-922d-5bf6df22c8a8', '3476cea7-bd89-45f5-96b3-c0b8e5e6b72e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733daf95-32f1-4b8f-8b22-f92dd5d93de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fa294e-b916-4563-9852-767354a6c3e9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa40ad7-bafa-41e3-9716-3acb033be410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Volume volume-38fa294e-b916-4563-9852-767354a6c3e9 (38fa294e-b916-4563-9852-767354a6c3e9): created successfully Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa40ad7-bafa-41e3-9716-3acb033be410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Flow 'volume_create_manager' (ed9bbb58-788d-407c-ae77-f142ad7f79f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-43cf5b94-2f43-4784-841e-d03ca9e4d6b3 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created volume successfully. Sep 29 12:52:19 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.351s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Deleted volume successfully. Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:19 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:19 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f6e07df-90f9-4e3f-8d39-b1042f6f6ad5 tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-261a5bfd-2233-4378-8654-c99e86a03568-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:19 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Deleted volume successfully. Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7453feb-61b5-4895-a0c5-713285f4c791 tempest-VolumeAndVolumeTypeFromImageTest-60923496 None] Lock "cinder-487f3565-492a-4e25-8e08-dc5e61d98d25-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-38fa294e-b916-4563-9852-767354a6c3e9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-38fa294e-b916-4563-9852-767354a6c3e9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-38fa294e-b916-4563-9852-767354a6c3e9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-38fa294e-b916-4563-9852-767354a6c3e9" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-f13f712d-eaef-4009-b515-46bdff48d9aa-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-f13f712d-eaef-4009-b515-46bdff48d9aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b47fd-1d8e-44b9-bd98-d62f9b1a6c40]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[411bd915-f426-4c34-b744-ba405841bfeb]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:20 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 Sep 29 12:52:20 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:20 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa Sep 29 12:52:20 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:20 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9" returned: 0 in 0.464s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:20 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9 Sep 29 12:52:20 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:20 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa" returned: 0 in 0.475s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:20 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa Sep 29 12:52:20 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:20 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-38fa294e-b916-4563-9852-767354a6c3e9" returned: 0 in 0.328s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-38fa294e-b916-4563-9852-767354a6c3e9" released by "delete_volume" :: held 0.876s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:20 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f13f712d-eaef-4009-b515-46bdff48d9aa" returned: 0 in 0.293s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['f0072191-4150-4ff2-aaa7-edf8f695065d', 'df74d2e0-c26e-468b-b657-c77fb3956225', '92c84e8e-7328-4110-a3a7-c6df79ede19f', '4d0324d0-6604-477b-b84a-0b72db283080'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-quobyte-f13f712d-eaef-4009-b515-46bdff48d9aa" released by "delete_volume" :: held 0.822s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:21 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:21 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Created reservations ['b2c8a8ef-714f-4e32-b06c-c3c60b53413d', '1bff86b9-d8d2-452c-b9f1-951b63177b96', '64673fa6-50c6-47da-8997-717fa82f267b', '9a9dc990-4b6a-4d86-811c-b2f077f804d1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-39e3a6c7-1de3-4f75-b91a-eeed7a05b276-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-39e3a6c7-1de3-4f75-b91a-eeed7a05b276-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443255b-1d97-4c2b-a100-ff8da9aa6abd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:21 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:21 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:21 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 Sep 29 12:52:21 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:21 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.477s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-05bccd66-266a-46f6-b950-b06444a3080b tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-38fa294e-b916-4563-9852-767354a6c3e9-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:21 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Deleted volume successfully. Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07248004-4c92-4fc3-95c5-43a70de4b54b tempest-VolumeDependencyTests-1138669831 None] Lock "cinder-f13f712d-eaef-4009-b515-46bdff48d9aa-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:21 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" returned: 0 in 0.485s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:21 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276 Sep 29 12:52:21 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:22 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" returned: 0 in 0.309s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-39e3a6c7-1de3-4f75-b91a-eeed7a05b276" released by "delete_volume" :: held 0.865s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['41925d7c-f796-49e6-b0ea-670ca509ffa6', 'b5a715fb-8490-4941-a675-ea5ba577146c', 'f95169b8-1a27-4c65-8b43-0ebc8e7a1197', '15479682-5e39-48bf-b560-91f980c1e314'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:22 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:22 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:22 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.340s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-041443cb-5e87-4ba1-89ee-406ed9d9a050 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-39e3a6c7-1de3-4f75-b91a-eeed7a05b276-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-8db1eb38-08d1-4591-a2f1-e233a661fb7f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-8db1eb38-08d1-4591-a2f1-e233a661fb7f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-8db1eb38-08d1-4591-a2f1-e233a661fb7f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8db1eb38-08d1-4591-a2f1-e233a661fb7f" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a9791-6d06-41ab-8c88-30d7e3695704]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:23 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f Sep 29 12:52:23 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:24 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f" returned: 0 in 0.526s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:24 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f Sep 29 12:52:24 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:24 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8db1eb38-08d1-4591-a2f1-e233a661fb7f" returned: 0 in 0.350s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8db1eb38-08d1-4591-a2f1-e233a661fb7f" released by "delete_volume" :: held 0.972s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['9eeae573-d8b0-4f51-b2fb-87e6b34ac8fc', '521b37ca-8d50-4925-82c2-16751e924cb0', '48048fde-cb86-4fbc-bf8c-4fa7f16539bb', '0fafddd0-c517-4e7e-9566-d03caae65e31'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:24 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:24 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-ca448049-51f8-4692-8f9c-07cf439205f1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-ca448049-51f8-4692-8f9c-07cf439205f1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-ca448049-51f8-4692-8f9c-07cf439205f1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-ca448049-51f8-4692-8f9c-07cf439205f1" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2254e2ef-afb1-48eb-9ca0-79bb5b142361]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:25 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:25 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 Sep 29 12:52:25 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee7d8244-1925-4177-a010-4eb8b58828d0 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-8db1eb38-08d1-4591-a2f1-e233a661fb7f-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Flow 'volume_create_manager' (39a56ad9-6740-45fe-8dff-1c386a00fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5522713f-d079-4243-80f9-6d0f3320c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5522713f-d079-4243-80f9-6d0f3320c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd97099-6799-49e1-953a-0893acec8da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c565f3e5017a48f081b7eddebc871208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:25Z,use_quota=True,user_id='5079865f8a9348b5b4a569b5a405fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7000f3a7-9ba8-4936-a6e9-abc2e5cd7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7000f3a7-9ba8-4936-a6e9-abc2e5cd7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cf87ff-1dd1-47d2-bb69-b4960a3962a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:52:25 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1" returned: 0 in 0.534s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:25 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1 Sep 29 12:52:25 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:25 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ca448049-51f8-4692-8f9c-07cf439205f1" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-ca448049-51f8-4692-8f9c-07cf439205f1" released by "delete_volume" :: held 0.879s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['0c56c58d-63d5-44e5-b2db-19bdbc0b8806', 'ef2d9f69-2097-41cd-8063-ca56e3bd1426', '06877049-5c6b-4d2b-9afa-0c1dcbc865bf', '520ce4a1-f059-402c-b069-a4b751b2610b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:26 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:26 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cf87ff-1dd1-47d2-bb69-b4960a3962a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfd97099-6799-49e1-953a-0893acec8da6', 'volume_name': 'volume-cfd97099-6799-49e1-953a-0893acec8da6', 'volume_size': 1, 'image_id': '08849dda-6058-43b5-b894-ecf6158fba74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8af39a83c296c353e7b2f2e00ae5a27f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c565f3e5017a48f081b7eddebc871208', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a755605633642df8cd8ac61656a77fee33004511960553205dccc9dcf9d447c05eda6b5e47ce990f0b9ebc73c5188baa6b6ac9c7c810f2587010e3e33cf0c4de', 'id': '08849dda-6058-43b5-b894-ecf6158fba74', 'created_at': datetime.datetime(2026, 9, 29, 10, 52, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 52, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08849dda-6058-43b5-b894-ecf6158fba74/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282ea9cb-590c-4d07-8b1b-feb7e5d87956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282ea9cb-590c-4d07-8b1b-feb7e5d87956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158ab06-bfba-405f-b5d8-d9b3f9b16977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Volume cfd97099-6799-49e1-953a-0893acec8da6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfd97099-6799-49e1-953a-0893acec8da6', 'volume_size': 1, 'image_id': '08849dda-6058-43b5-b894-ecf6158fba74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8af39a83c296c353e7b2f2e00ae5a27f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c565f3e5017a48f081b7eddebc871208', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a755605633642df8cd8ac61656a77fee33004511960553205dccc9dcf9d447c05eda6b5e47ce990f0b9ebc73c5188baa6b6ac9c7c810f2587010e3e33cf0c4de', 'id': '08849dda-6058-43b5-b894-ecf6158fba74', 'created_at': datetime.datetime(2026, 9, 29, 10, 52, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 52, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08849dda-6058-43b5-b894-ecf6158fba74/file', 'properties': {}}, 'image_service': } Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Trying to clone cfd97099-6799-49e1-953a-0893acec8da6 from image 08849dda-6058-43b5-b894-ecf6158fba74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:52:26 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[65967d7a-a408-4dea-adb1-22b8655f32d7]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:26 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.370s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:26 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:26 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c7407b30-b2b6-4f6b-9057-750cd15f559c tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-ca448049-51f8-4692-8f9c-07cf439205f1-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:26 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:26 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:26 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (a0f6ea6a-a7e4-4033-9361-98d8f1205926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf121f6-ed48-494d-9d65-332a08f30e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf121f6-ed48-494d-9d65-332a08f30e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952852120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0765fad6-be2b-43ce-863f-e219934a3673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:27Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e3e70-f558-4ac8-8312-a45e919812e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e3e70-f558-4ac8-8312-a45e919812e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c030087-48b7-4979-975e-2e411ab2d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c030087-48b7-4979-975e-2e411ab2d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0765fad6-be2b-43ce-863f-e219934a3673', 'volume_name': 'volume-0765fad6-be2b-43ce-863f-e219934a3673', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8e6bc-324f-46b4-8956-852050e4b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8e6bc-324f-46b4-8956-852050e4b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314adbc5-5b5a-42ea-9451-8ec6bf9b998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Volume 0765fad6-be2b-43ce-863f-e219934a3673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0765fad6-be2b-43ce-863f-e219934a3673', 'volume_size': 1} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952852120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0765fad6-be2b-43ce-863f-e219934a3673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:27Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Creating volume 0765fad6-be2b-43ce-863f-e219934a3673 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:27 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:27 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 1073741824 Sep 29 12:52:27 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:27 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Temporary image 08849dda-6058-43b5-b894-ecf6158fba74 is fetched for user 5079865f8a9348b5b4a569b5a405fbfd. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" acquired by "delete_volume" :: waited 0.063s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8913daa5-c390-4a13-a7ed-1ecda6b14eda]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d95dc6-3ef4-4acb-ae06-b7a1f682897d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:27 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:27 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:27 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 Sep 29 12:52:27 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:27 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 1073741824" returned: 0 in 0.802s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (1d095832-560d-48af-b704-955878d90e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c5a89a-513a-4b70-9c81-dfdf48607bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c5a89a-513a-4b70-9c81-dfdf48607bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249980026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0905f60-4fc1-4c16-be6a-04332481faa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470b772f-1697-4346-a784-25ec478c06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470b772f-1697-4346-a784-25ec478c06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a8735b-c29c-42d8-94f2-f7946bf49800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a8735b-c29c-42d8-94f2-f7946bf49800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0905f60-4fc1-4c16-be6a-04332481faa5', 'volume_name': 'volume-c0905f60-4fc1-4c16-be6a-04332481faa5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ae086c-186b-4f31-a56c-5b56a570804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ae086c-186b-4f31-a56c-5b56a570804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cddeb0-dca7-488f-a98a-8932994ccca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Volume c0905f60-4fc1-4c16-be6a-04332481faa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0905f60-4fc1-4c16-be6a-04332481faa5', 'volume_size': 1} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:28 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 Sep 29 12:52:28 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:28 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" returned: 0 in 0.613s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:28 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2 Sep 29 12:52:28 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (825632a2-c5b7-4e04-85e6-0f489c5a0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0179e379-21ee-4519-9518-85bb14aa0ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:28 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0179e379-21ee-4519-9518-85bb14aa0ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776666888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec9b885-7ef6-406c-8cda-6c640d1c3640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcddcdf-77b7-4c4c-8565-12b37c979ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcddcdf-77b7-4c4c-8565-12b37c979ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50654607-5a33-4689-838a-5f1ccec23208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50654607-5a33-4689-838a-5f1ccec23208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec9b885-7ef6-406c-8cda-6c640d1c3640', 'volume_name': 'volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8970a628-4080-4900-8ac2-2ab17b1050f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8970a628-4080-4900-8ac2-2ab17b1050f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcb5cdf-e14d-442a-9ccd-22a604f4919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Volume 9ec9b885-7ef6-406c-8cda-6c640d1c3640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640', 'volume_size': 1} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (4083bd9e-d4b2-47c1-9151-8bb53dcf0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:28 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895dca01-7096-4cfb-913e-420557ac9354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673" returned: 0 in 0.510s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249980026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0905f60-4fc1-4c16-be6a-04332481faa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Creating volume c0905f60-4fc1-4c16-be6a-04332481faa5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:28 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895dca01-7096-4cfb-913e-420557ac9354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137227510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e07062-c88d-4ec7-9685-5d01c5a42232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118265c3-40ed-43b4-a88b-da5c372b7bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118265c3-40ed-43b4-a88b-da5c372b7bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9738652-3064-4264-8391-332a9d97668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 1073741824 Sep 29 12:52:28 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9738652-3064-4264-8391-332a9d97668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e07062-c88d-4ec7-9685-5d01c5a42232', 'volume_name': 'volume-01e07062-c88d-4ec7-9685-5d01c5a42232', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c3f62-dfd0-4ee2-bd1c-928a7b9d096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c3f62-dfd0-4ee2-bd1c-928a7b9d096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7504a7-653e-4787-af4c-345777110e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Volume 01e07062-c88d-4ec7-9685-5d01c5a42232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e07062-c88d-4ec7-9685-5d01c5a42232', 'volume_size': 1} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" returned: 0 in 0.521s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:28 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314adbc5-5b5a-42ea-9451-8ec6bf9b998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0765fad6-be2b-43ce-863f-e219934a3673', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8b1802-5697-4609-9a5f-626232e074fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 1 in 0.637s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2" released by "delete_volume" :: held 1.230s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Volume volume-0765fad6-be2b-43ce-863f-e219934a3673 (0765fad6-be2b-43ce-863f-e219934a3673): created successfully Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8b1802-5697-4609-9a5f-626232e074fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (a0f6ea6a-a7e4-4033-9361-98d8f1205926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9376cc8d-c446-471d-aa40-b75db92d9336 tempest-CreateVolumesFromImageTest-944878837 None] Created volume successfully. Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['d8efbf80-0a5c-4105-a3cf-d2e882fa56da', 'a0f97ffa-14ee-4331-b1de-9e4488f1affa', '7ec701b2-4c39-4028-abf3-b6d0167ec531', 'cf43ab96-2818-474b-97ce-e634b570187b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:28 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:28 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (389a7d80-ad6a-4af1-bf9b-7a81539ef13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728f31cd-e8b6-4ebf-857a-c1e7bf6c16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728f31cd-e8b6-4ebf-857a-c1e7bf6c16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576362502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2baa24f-443b-4c8c-806e-9507f60c9f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:29Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a14e03-cdd2-4376-9369-6fed62517e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a14e03-cdd2-4376-9369-6fed62517e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e95e76-ac32-467d-9827-2589c92f6036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e95e76-ac32-467d-9827-2589c92f6036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2baa24f-443b-4c8c-806e-9507f60c9f41', 'volume_name': 'volume-b2baa24f-443b-4c8c-806e-9507f60c9f41', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e219514-d3f5-4272-a24e-deb8bb03cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e219514-d3f5-4272-a24e-deb8bb03cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399d0f53-2590-4ae3-be58-f26afb4c6499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Volume b2baa24f-443b-4c8c-806e-9507f60c9f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2baa24f-443b-4c8c-806e-9507f60c9f41', 'volume_size': 1} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:29 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:29 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 1073741824" returned: 0 in 0.677s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a7a6a1a-498f-431d-a050-63800f20bb22 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-3d470e8d-8b10-4de1-b3b3-0b6a98f199e2-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:29 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 Sep 29 12:52:29 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:29 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5" returned: 0 in 0.274s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776666888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec9b885-7ef6-406c-8cda-6c640d1c3640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Creating volume 9ec9b885-7ef6-406c-8cda-6c640d1c3640 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:29 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:29 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 1073741824 Sep 29 12:52:29 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cddeb0-dca7-488f-a98a-8932994ccca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0905f60-4fc1-4c16-be6a-04332481faa5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09e8dc-34ae-4ec4-bf1b-0b883d656257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Volume volume-c0905f60-4fc1-4c16-be6a-04332481faa5 (c0905f60-4fc1-4c16-be6a-04332481faa5): created successfully Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09e8dc-34ae-4ec4-bf1b-0b883d656257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (1d095832-560d-48af-b704-955878d90e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e46ad097-20b9-4b6b-954b-30d96f8ef9f5 tempest-CreateVolumesFromImageTest-944878837 None] Created volume successfully. Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-3192745f-fa52-4e9b-bd57-8b856f55e1bf-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-3192745f-fa52-4e9b-bd57-8b856f55e1bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-3192745f-fa52-4e9b-bd57-8b856f55e1bf" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-3192745f-fa52-4e9b-bd57-8b856f55e1bf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleting offline snapshot 3192745f-fa52-4e9b-bd57-8b856f55e1bf of volume 8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] snapshot_file for this snap is: volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d9c89-005c-417e-8fe8-7623497e0a13]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf Sep 29 12:52:30 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 1073741824" returned: 0 in 0.540s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 Sep 29 12:52:30 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:30 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf" returned: 0 in 0.391s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b5369-8046-4b2e-8455-997667fe9885]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640" returned: 0 in 0.287s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137227510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e07062-c88d-4ec7-9685-5d01c5a42232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:28Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Creating volume 01e07062-c88d-4ec7-9685-5d01c5a42232 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c Sep 29 12:52:30 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcb5cdf-e14d-442a-9ccd-22a604f4919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:30 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 1073741824 Sep 29 12:52:30 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5016dbcc-5b37-4773-92c1-51594e4369af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Volume volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 (9ec9b885-7ef6-406c-8cda-6c640d1c3640): created successfully Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5016dbcc-5b37-4773-92c1-51594e4369af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (825632a2-c5b7-4e04-85e6-0f489c5a0a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-066732b0-0a9f-4112-bdb2-97a228c921f7 tempest-CreateVolumesFromImageTest-944878837 None] Created volume successfully. Sep 29 12:52:30 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:52:30 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:30 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf Sep 29 12:52:30 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:30 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 1073741824" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:31 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 Sep 29 12:52:31 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:31 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf" returned: 0 in 0.459s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:31 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf Sep 29 12:52:31 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:31 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232" returned: 0 in 0.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd97099-6799-49e1-953a-0893acec8da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c565f3e5017a48f081b7eddebc871208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:25Z,use_quota=True,user_id='5079865f8a9348b5b4a569b5a405fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Creating volume cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:31 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7504a7-653e-4787-af4c-345777110e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e07062-c88d-4ec7-9685-5d01c5a42232', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:31 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1073741824 Sep 29 12:52:31 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7293a0-80ac-46ff-93fa-fe1ad0806ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Volume volume-01e07062-c88d-4ec7-9685-5d01c5a42232 (01e07062-c88d-4ec7-9685-5d01c5a42232): created successfully Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7293a0-80ac-46ff-93fa-fe1ad0806ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (4083bd9e-d4b2-47c1-9151-8bb53dcf0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d9ff6d0c-1e62-4536-b986-51cd41dc2952 tempest-CreateVolumesFromImageTest-944878837 None] Created volume successfully. Sep 29 12:52:31 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c.3192745f-fa52-4e9b-bd57-8b856f55e1bf" returned: 0 in 0.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-3192745f-fa52-4e9b-bd57-8b856f55e1bf" released by "_delete_snapshot" :: held 1.718s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" released by "delete_snapshot" :: held 1.754s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['5c62a6bf-47f4-4f0b-a43e-df67f488cb63', '0449a381-bf6f-4c9a-a4d2-dcb84d7d35b9', '73caba5e-f62b-4880-b175-e3bf394bed98', 'c8a82af6-9236-4131-b7d6-d538d9292381'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Delete snapshot completed successfully. Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ec524b8c-6f03-447c-9bfc-704ad7674574 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-3192745f-fa52-4e9b-bd57-8b856f55e1bf-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:31 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1073741824" returned: 0 in 0.519s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:31 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 Sep 29 12:52:31 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbd924-6cbb-4981-9070-aa693fd8208b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6" returned: 0 in 0.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.097s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576362502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2baa24f-443b-4c8c-806e-9507f60c9f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafb1b6788449e0b865fbfde62d06a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:29Z,use_quota=True,user_id='014d40a59acf48519348547411cb500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Creating volume b2baa24f-443b-4c8c-806e-9507f60c9f41 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:32 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c Sep 29 12:52:32 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 1073741824 Sep 29 12:52:32 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Attempting download of 08849dda-6058-43b5-b894-ecf6158fba74 ((None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}])) to volume cfd97099-6799-49e1-953a-0893acec8da6. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d524a38-5f51-4e47-9c5e-cc9776d6e437]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra Sep 29 12:52:32 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c Sep 29 12:52:32 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 1073741824" returned: 0 in 0.462s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:32 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:32 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 Sep 29 12:52:32 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-quobyte-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c" released by "delete_volume" :: held 0.760s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:32 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra Sep 29 12:52:32 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Created reservations ['adf0a43b-e59c-44da-b992-8cbf59e4818f', '7dee7dd2-2b46-4343-9cd1-0e511ce37416', '2ed4553f-47fd-4a4f-b2da-a12b4c0e83f2', '24a6b874-d2f3-454c-a4a0-48d2aa99c736'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:33 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:33 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:33 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41" returned: 0 in 0.358s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399d0f53-2590-4ae3-be58-f26afb4c6499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2baa24f-443b-4c8c-806e-9507f60c9f41', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6da6e70-091b-45d8-b7c1-415901c003f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:33 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Volume volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 (b2baa24f-443b-4c8c-806e-9507f60c9f41): created successfully Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6da6e70-091b-45d8-b7c1-415901c003f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Flow 'volume_create_manager' (389a7d80-ad6a-4af1-bf9b-7a81539ef13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra" returned: 1 in 0.443s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08849dda-6058-43b5-b894-ecf6158fba74_vfa2uxra' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d90f30-62c0-4f01-b14a-3dad4e877da3]: (4, 'raw') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-34e05ce3-5415-4579-9f49-7ee1801c3ab4 tempest-CreateVolumesFromImageTest-944878837 None] Created volume successfully. Sep 29 12:52:33 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:33 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:33 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.364s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Deleted volume successfully. Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2fc1d27-65fc-4831-ae9d-f926eb490403 tempest-CreateVolumesFromSnapshotTest-149306426 None] Lock "cinder-8c8d2fe0-c63e-475d-b4cb-edd0275ee38c-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-b2baa24f-443b-4c8c-806e-9507f60c9f41-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-b2baa24f-443b-4c8c-806e-9507f60c9f41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:33 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-quobyte-b2baa24f-443b-4c8c-806e-9507f60c9f41" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-b2baa24f-443b-4c8c-806e-9507f60c9f41" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f103b-eba6-489d-82db-f10e015bc5c7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:33 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD Sep 29 12:52:33 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:33 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 Sep 29 12:52:33 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:34 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] 08849dda-6058-43b5-b894-ecf6158fba74 was raw, converting to qcow2 {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:34 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 Sep 29 12:52:34 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:34 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41" returned: 0 in 0.595s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:34 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41 Sep 29 12:52:34 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:34 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:34 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6" returned: 0 in 0.617s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08849dda-6058-43b5-b894-ecf6158fba74_shvr0a52devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:52:34 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-b2baa24f-443b-4c8c-806e-9507f60c9f41" returned: 0 in 0.379s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:34 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1G Sep 29 12:52:34 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-b2baa24f-443b-4c8c-806e-9507f60c9f41" released by "delete_volume" :: held 1.051s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Created reservations ['a25a5672-faa9-423c-9162-f2b9545b99e0', 'ab5e8296-a17e-4ac2-95c8-05825e3c9ee1', '64ff7ddc-270b-4b21-afb2-d9119738270c', '0b072295-b4ab-4f1c-9922-5dc1d436483f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:35 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:35 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:35 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 1G" returned: 0 in 0.454s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Downloaded image 08849dda-6058-43b5-b894-ecf6158fba74 ((None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}])) to volume cfd97099-6799-49e1-953a-0893acec8da6 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Temporary image 08849dda-6058-43b5-b894-ecf6158fba74 for user 5079865f8a9348b5b4a569b5a405fbfd is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Marking volume cfd97099-6799-49e1-953a-0893acec8da6 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Copying metadata from image 08849dda-6058-43b5-b894-ecf6158fba74 to cfd97099-6799-49e1-953a-0893acec8da6. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Creating volume glance metadata for volume cfd97099-6799-49e1-953a-0893acec8da6 backed by image 08849dda-6058-43b5-b894-ecf6158fba74 with: {'image_id': '08849dda-6058-43b5-b894-ecf6158fba74', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8af39a83c296c353e7b2f2e00ae5a27f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158ab06-bfba-405f-b5d8-d9b3f9b16977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd97099-6799-49e1-953a-0893acec8da6', 'volume_size': 1, 'image_id': '08849dda-6058-43b5-b894-ecf6158fba74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08849dda-6058-43b5-b894-ecf6158fba74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8af39a83c296c353e7b2f2e00ae5a27f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c565f3e5017a48f081b7eddebc871208', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a755605633642df8cd8ac61656a77fee33004511960553205dccc9dcf9d447c05eda6b5e47ce990f0b9ebc73c5188baa6b6ac9c7c810f2587010e3e33cf0c4de', 'id': '08849dda-6058-43b5-b894-ecf6158fba74', 'created_at': datetime.datetime(2026, 9, 29, 10, 52, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 52, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08849dda-6058-43b5-b894-ecf6158fba74/file', 'properties': {}}, 'image_service': }' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:35 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73d088f-0f7e-41ad-9caa-7e4652c60b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.332s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Deleted volume successfully. Sep 29 12:52:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Volume volume-cfd97099-6799-49e1-953a-0893acec8da6 (cfd97099-6799-49e1-953a-0893acec8da6): created successfully Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73d088f-0f7e-41ad-9caa-7e4652c60b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Flow 'volume_create_manager' (39a56ad9-6740-45fe-8dff-1c386a00fc75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70e957b5-44e7-40b5-bf54-1909cbbfea29 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-b2baa24f-443b-4c8c-806e-9507f60c9f41-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fbf75f19-97f8-4507-bcc1-44be7c012bbe tempest-VolumeImageDependencyTests-148953436 None] Created volume successfully. Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-01e07062-c88d-4ec7-9685-5d01c5a42232-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-01e07062-c88d-4ec7-9685-5d01c5a42232-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-quobyte-01e07062-c88d-4ec7-9685-5d01c5a42232" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-01e07062-c88d-4ec7-9685-5d01c5a42232" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6cbcbc-957a-4930-b894-dbeec8e85acc]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:36 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 Sep 29 12:52:36 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:36 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:36 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232 Sep 29 12:52:36 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Acquiring lock "cinder-cfd97099-6799-49e1-953a-0893acec8da6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "cinder-cfd97099-6799-49e1-953a-0893acec8da6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Acquiring lock "cinder-quobyte-cfd97099-6799-49e1-953a-0893acec8da6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "cinder-quobyte-cfd97099-6799-49e1-953a-0893acec8da6" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf313d2c-0b1e-44c4-bf0c-abffa019f86f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:36 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01e07062-c88d-4ec7-9685-5d01c5a42232" returned: 0 in 0.382s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-01e07062-c88d-4ec7-9685-5d01c5a42232" released by "delete_volume" :: held 0.805s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:36 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 Sep 29 12:52:36 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Created reservations ['65d031fd-30f8-4f5c-ae7c-847bdee784fb', '20eb53b3-ca3c-4306-9684-d560866911f8', 'f9b30bf4-f5cd-46e0-8c69-d8ae1fb2158b', 'fb9fb869-9fb0-4b5d-a1ed-7d6ad198dedd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:36 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:36 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-9ec9b885-7ef6-406c-8cda-6c640d1c3640-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:37 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6" returned: 0 in 0.476s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-9ec9b885-7ef6-406c-8cda-6c640d1c3640-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:37 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6 Sep 29 12:52:37 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-quobyte-9ec9b885-7ef6-406c-8cda-6c640d1c3640" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-9ec9b885-7ef6-406c-8cda-6c640d1c3640" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df8989-ff91-451e-b94f-a42b7713c846]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:37 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.452s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Deleted volume successfully. Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a8dee8-232f-4cbc-bc95-911dd4c657ca tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-01e07062-c88d-4ec7-9685-5d01c5a42232-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:37 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-cfd97099-6799-49e1-953a-0893acec8da6" returned: 0 in 0.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:37 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 Sep 29 12:52:37 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "cinder-quobyte-cfd97099-6799-49e1-953a-0893acec8da6" released by "delete_volume" :: held 0.892s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Created reservations ['10a21ed4-4c8f-479a-a928-62762da5099f', '9526d4cf-5e92-4052-959b-25f185f9c7a2', 'c7dfd2f4-5aaa-4fab-8af2-3227f96dae2a', 'e5dcca47-4630-45cc-bd97-753464ef1a7c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:37 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:37 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:37 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640" returned: 0 in 0.632s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:38 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640 Sep 29 12:52:38 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:38 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.429s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Deleted volume successfully. Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3b0e8c6-bc04-4548-87b4-74d01d0dc2e1 tempest-VolumeImageDependencyTests-148953436 None] Lock "cinder-cfd97099-6799-49e1-953a-0893acec8da6-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:38 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-9ec9b885-7ef6-406c-8cda-6c640d1c3640" returned: 0 in 0.377s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-9ec9b885-7ef6-406c-8cda-6c640d1c3640" released by "delete_volume" :: held 1.070s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Created reservations ['bc25c68c-d64b-461f-b680-fa0288d47c61', '7eebd3ce-93b0-47d4-8fb7-1db63e2fba81', '2e569c3b-d5a2-4915-a75e-c9526ddb9f22', 'c7282ca3-dc37-4311-a000-994484e2f8ba'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:38 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:38 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:38 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Deleted volume successfully. Sep 29 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-49d9f925-acf3-4d69-b318-374cca7cce53 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-9ec9b885-7ef6-406c-8cda-6c640d1c3640-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-c0905f60-4fc1-4c16-be6a-04332481faa5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-c0905f60-4fc1-4c16-be6a-04332481faa5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-quobyte-c0905f60-4fc1-4c16-be6a-04332481faa5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-c0905f60-4fc1-4c16-be6a-04332481faa5" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a9da2-0fea-4861-80f6-9d525d5e8c4a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:39 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 Sep 29 12:52:39 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:40 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5" returned: 0 in 0.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:40 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5 Sep 29 12:52:40 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:40 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c0905f60-4fc1-4c16-be6a-04332481faa5" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-c0905f60-4fc1-4c16-be6a-04332481faa5" released by "delete_volume" :: held 0.969s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Created reservations ['0087c0d6-26d1-41e4-9629-163356a5654a', 'e65f16d7-0229-45df-a1b5-50414b458f64', 'b84ceefd-82d1-41fa-81b8-e12260684349', '81298368-48e0-4421-a377-4684b22ed9fd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:40 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:40 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:40 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Deleted volume successfully. Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2bf37490-1eea-4b8f-a01a-f56fa23e06ed tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-c0905f60-4fc1-4c16-be6a-04332481faa5-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-0765fad6-be2b-43ce-863f-e219934a3673-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-0765fad6-be2b-43ce-863f-e219934a3673-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "cinder-quobyte-0765fad6-be2b-43ce-863f-e219934a3673" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-0765fad6-be2b-43ce-863f-e219934a3673" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[699cba0a-447f-48de-a6f1-bbd414f3d011]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Flow 'volume_create_manager' (e7d9d6c6-9029-45a3-a091-cd26345e0848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a27b2-bfe4-4d1b-a3ff-fbd5f58de4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:42 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 Sep 29 12:52:42 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a27b2-bfe4-4d1b-a3ff-fbd5f58de4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1370e74f-cdec-433d-ae0f-df1020054bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b174989ada4146841341355a6df448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:42Z,use_quota=True,user_id='3a6a003bcd054352a8eca183963a9544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76132b90-20c8-40ab-8b48-247fc864f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76132b90-20c8-40ab-8b48-247fc864f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd9f9c4-5424-480b-a2fa-1f9b9c43218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd9f9c4-5424-480b-a2fa-1f9b9c43218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1370e74f-cdec-433d-ae0f-df1020054bc1', 'volume_name': 'volume-1370e74f-cdec-433d-ae0f-df1020054bc1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625fd5b-367c-44fe-b281-5d6dd9a1817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625fd5b-367c-44fe-b281-5d6dd9a1817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d51c06d-2650-4bc2-b1c8-d86478566540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Volume 1370e74f-cdec-433d-ae0f-df1020054bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1370e74f-cdec-433d-ae0f-df1020054bc1', 'volume_size': 1} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1370e74f-cdec-433d-ae0f-df1020054bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b174989ada4146841341355a6df448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:42Z,use_quota=True,user_id='3a6a003bcd054352a8eca183963a9544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Creating volume 1370e74f-cdec-433d-ae0f-df1020054bc1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:42 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:42 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 1073741824 Sep 29 12:52:42 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:42 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673" returned: 0 in 0.442s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:42 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673 Sep 29 12:52:42 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:42 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-0765fad6-be2b-43ce-863f-e219934a3673" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-quobyte-0765fad6-be2b-43ce-863f-e219934a3673" released by "delete_volume" :: held 0.803s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:42 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 1073741824" returned: 0 in 0.571s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Created reservations ['fa3f0810-e1e0-474a-81de-307a12a026b1', 'fc06a154-e10e-4b69-91f7-21c3d9887cee', '637e607b-b6c2-4531-a212-36bf5aea02f2', '654ca060-f796-4372-a488-febdf57cd155'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:42 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 Sep 29 12:52:42 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:42 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:42 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:43 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1" returned: 0 in 0.343s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d51c06d-2650-4bc2-b1c8-d86478566540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1370e74f-cdec-433d-ae0f-df1020054bc1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ea852-4e53-4444-8e65-7d4daf2f9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Volume volume-1370e74f-cdec-433d-ae0f-df1020054bc1 (1370e74f-cdec-433d-ae0f-df1020054bc1): created successfully Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ea852-4e53-4444-8e65-7d4daf2f9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Flow 'volume_create_manager' (e7d9d6c6-9029-45a3-a091-cd26345e0848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cd08b37f-abfc-41a0-b93e-905ac5680b50 tempest-CinderUnicodeTest-1189343433 None] Created volume successfully. Sep 29 12:52:43 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.329s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Deleted volume successfully. Sep 29 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1a9d9dcd-4a7e-4e29-a5b0-12856b387b33 tempest-CreateVolumesFromImageTest-944878837 None] Lock "cinder-0765fad6-be2b-43ce-863f-e219934a3673-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (e217e2d5-b471-4b36-a196-2198996bb8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a873a71-8e85-41e3-9002-214f2fda69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a873a71-8e85-41e3-9002-214f2fda69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451677022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738ca5ed-6541-4389-bc18-aebf4939f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:44Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d9261e-807a-4430-86b4-b69ba63e96b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d9261e-807a-4430-86b4-b69ba63e96b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0512f8-1c0b-402a-9ea0-e1a514f6ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0512f8-1c0b-402a-9ea0-e1a514f6ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738ca5ed-6541-4389-bc18-aebf4939f109', 'volume_name': 'volume-738ca5ed-6541-4389-bc18-aebf4939f109', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f50ac8-217b-4dc5-91ee-3229ca07d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f50ac8-217b-4dc5-91ee-3229ca07d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b35df76-79a9-4e9c-b6f0-454d22b97aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Volume 738ca5ed-6541-4389-bc18-aebf4939f109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738ca5ed-6541-4389-bc18-aebf4939f109', 'volume_size': 1} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451677022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738ca5ed-6541-4389-bc18-aebf4939f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:44Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Creating volume 738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:44 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 1073741824 Sep 29 12:52:44 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Flow 'volume_create_manager' (4845c702-71c4-4416-afeb-59c0c09c449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a49b9e-677e-4d7d-9baa-3b782891e24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a49b9e-677e-4d7d-9baa-3b782891e24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-531506144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c203c6-2d7e-4801-8006-4e049af111c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b174989ada4146841341355a6df448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:45Z,use_quota=True,user_id='3a6a003bcd054352a8eca183963a9544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb39859-2da7-473b-a3ff-74f03a365a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb39859-2da7-473b-a3ff-74f03a365a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549377c4-7e75-483a-8523-aa4f6432ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549377c4-7e75-483a-8523-aa4f6432ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c203c6-2d7e-4801-8006-4e049af111c6', 'volume_name': 'volume-15c203c6-2d7e-4801-8006-4e049af111c6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e826432-8187-44cb-80ea-7799772e9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e826432-8187-44cb-80ea-7799772e9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc8f2b-963c-4890-837c-ab60a578e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Volume 15c203c6-2d7e-4801-8006-4e049af111c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c203c6-2d7e-4801-8006-4e049af111c6', 'volume_size': 1} Sep 29 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:45 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 1073741824" returned: 0 in 0.654s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:45 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 Sep 29 12:52:45 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:45 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-531506144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c203c6-2d7e-4801-8006-4e049af111c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b174989ada4146841341355a6df448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:45Z,use_quota=True,user_id='3a6a003bcd054352a8eca183963a9544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Creating volume 15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:45 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b35df76-79a9-4e9c-b6f0-454d22b97aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738ca5ed-6541-4389-bc18-aebf4939f109', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a937224-3af4-4463-935c-463611cc4777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:45 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 1073741824 Sep 29 12:52:45 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Volume volume-738ca5ed-6541-4389-bc18-aebf4939f109 (738ca5ed-6541-4389-bc18-aebf4939f109): created successfully Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a937224-3af4-4463-935c-463611cc4777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (e217e2d5-b471-4b36-a196-2198996bb8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f6870c00-8430-4efe-9653-7e6406357225 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:52:45 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 1073741824" returned: 0 in 0.566s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:45 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 Sep 29 12:52:45 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:46 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6" returned: 0 in 0.309s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc8f2b-963c-4890-837c-ab60a578e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c203c6-2d7e-4801-8006-4e049af111c6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba2d261-f042-44e1-a20b-b8b51ec39c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Volume volume-15c203c6-2d7e-4801-8006-4e049af111c6 (15c203c6-2d7e-4801-8006-4e049af111c6): created successfully Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba2d261-f042-44e1-a20b-b8b51ec39c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Flow 'volume_create_manager' (4845c702-71c4-4416-afeb-59c0c09c449c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ebad5ab1-4457-46c2-ad41-d7bfef0d261c tempest-CinderUnicodeTest-1189343433 None] Created volume successfully. Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=193,cinder:UPDATE=248,cinder:DELETE=24,cinder:INSERT=73 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=268,cinder:SELECT=177,cinder:INSERT=64,cinder:DELETE=23 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot 617efbd8-ebdb-45c7-ab62-a94a328a11c1 of volume 738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774a0b9-d34e-4612-b0b8-13d348dd0349]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:47 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 Sep 29 12:52:47 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:47 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109" returned: 0 in 0.532s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:47 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 1G Sep 29 12:52:47 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Flow 'volume_create_manager' (aed553aa-14e0-4622-9c39-e5901b44428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb514982-3f17-470b-97f7-e326d45bbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb514982-3f17-470b-97f7-e326d45bbe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329665969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fee0d0d-4d6d-4694-91d5-e53db0619b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b904bd30c74256b27b738fda8427a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:48Z,use_quota=True,user_id='de2925727145489cb9ee8cfb41d3e572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f92c1-36c2-4029-ba1b-78163eb500ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f92c1-36c2-4029-ba1b-78163eb500ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c89759-6ecf-47dd-abe7-392657d8189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c89759-6ecf-47dd-abe7-392657d8189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fee0d0d-4d6d-4694-91d5-e53db0619b43', 'volume_name': 'volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c038e85-9cda-43de-b660-cbd7d9fa3553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c038e85-9cda-43de-b660-cbd7d9fa3553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdac42-d846-4eeb-9f45-000d0bac093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:47 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Volume 1fee0d0d-4d6d-4694-91d5-e53db0619b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43', 'volume_size': 1} Sep 29 12:52:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:48 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 1G" returned: 0 in 0.536s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ca5ed-6541-4389-bc18-aebf4939f109 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:48 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ca5ed-6541-4389-bc18-aebf4939f109 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 Sep 29 12:52:48 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:48 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ca5ed-6541-4389-bc18-aebf4939f109 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1" returned: 0 in 0.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:48 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 is being set with open permissions: ugo+rw Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:48 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 Sep 29 12:52:48 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:48 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:48 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info Sep 29 12:52:48 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:48 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info" returned: 0 in 0.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:48 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info is being set with open permissions: ugo+rw Sep 29 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:48 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info Sep 29 12:52:48 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:49 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.info" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.969s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Creating offline snapshot cc528965-ecc4-46b7-8549-8829c827ad03 of volume 15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:52:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ba80d94d-ef17-4a21-adc3-c8518053d6da tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[053bcdb2-3192-4fc0-aeb5-8ade701a24f7]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:49 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 Sep 29 12:52:49 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:49 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6" returned: 0 in 0.412s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:49 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 1G Sep 29 12:52:49 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-617efbd8-ebdb-45c7-ab62-a94a328a11c1-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-617efbd8-ebdb-45c7-ab62-a94a328a11c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-617efbd8-ebdb-45c7-ab62-a94a328a11c1" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-617efbd8-ebdb-45c7-ab62-a94a328a11c1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot 617efbd8-ebdb-45c7-ab62-a94a328a11c1 of volume 738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3bb952-75a9-404d-add6-bd188c00815b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:50 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 1G" returned: 0 in 0.528s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c203c6-2d7e-4801-8006-4e049af111c6 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:50 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c203c6-2d7e-4801-8006-4e049af111c6 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 Sep 29 12:52:50 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:50 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 Sep 29 12:52:50 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:50 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c203c6-2d7e-4801-8006-4e049af111c6 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03" returned: 0 in 0.340s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:50 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 is being set with open permissions: ugo+rw Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:50 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 Sep 29 12:52:50 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:50 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1" returned: 0 in 0.404s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738ca5ed-6541-4389-bc18-aebf4939f109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[25835f65-ae4e-4597-a013-bb3081c88070]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:50 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 Sep 29 12:52:50 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:50 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03" returned: 0 in 0.274s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:50 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info Sep 29 12:52:50 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:51 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109" returned: 0 in 0.430s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:51 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 Sep 29 12:52:51 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:51 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info" returned: 0 in 0.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:51 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info is being set with open permissions: ugo+rw Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:51 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info Sep 29 12:52:51 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:51 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:51 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.info" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:51 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1 Sep 29 12:52:51 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.549s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329665969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fee0d0d-4d6d-4694-91d5-e53db0619b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b904bd30c74256b27b738fda8427a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:48Z,use_quota=True,user_id='de2925727145489cb9ee8cfb41d3e572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Creating volume 1fee0d0d-4d6d-4694-91d5-e53db0619b43 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:51 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 1073741824 Sep 29 12:52:51 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-23fc4254-f548-4a86-b8e4-f8882bef373c tempest-CinderUnicodeTest-1189343433 None] Create snapshot completed successfully Sep 29 12:52:51 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109.617efbd8-ebdb-45c7-ab62-a94a328a11c1" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-617efbd8-ebdb-45c7-ab62-a94a328a11c1" released by "_delete_snapshot" :: held 1.679s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" released by "delete_snapshot" :: held 1.711s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Created reservations ['06fdc848-0255-4d57-847d-5f4c61937a42', '37b437f1-c8c3-4d4f-b3db-9a1b71d173df', 'a3f106eb-b6b1-4a16-8a43-4b51790ed6bd', 'ae4366f0-1071-4a2a-b2a8-72eb9319bdde'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0bd9ed25-878b-4fac-a982-8df37542a29e tempest-ProjectMemberTests-1564258649 None] Lock "cinder-617efbd8-ebdb-45c7-ab62-a94a328a11c1-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:52 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 1073741824" returned: 0 in 0.538s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:52 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 Sep 29 12:52:52 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-738ca5ed-6541-4389-bc18-aebf4939f109-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-738ca5ed-6541-4389-bc18-aebf4939f109-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:52 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43" returned: 0 in 0.299s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2fd4d-5e11-44ef-90af-8c77f71f9ee0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdac42-d846-4eeb-9f45-000d0bac093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c67d42-2b17-4e03-ba3e-d8f92bac3125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Volume volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 (1fee0d0d-4d6d-4694-91d5-e53db0619b43): created successfully Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c67d42-2b17-4e03-ba3e-d8f92bac3125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Flow 'volume_create_manager' (aed553aa-14e0-4622-9c39-e5901b44428b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cc9396f2-34cf-489b-aea4-6cc0074f0750 tempest-ProjectReaderTests-1641402688 None] Created volume successfully. Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-cc528965-ecc4-46b7-8549-8829c827ad03-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-cc528965-ecc4-46b7-8549-8829c827ad03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-quobyte-cc528965-ecc4-46b7-8549-8829c827ad03" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:52 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 Sep 29 12:52:52 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-cc528965-ecc4-46b7-8549-8829c827ad03" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Deleting offline snapshot cc528965-ecc4-46b7-8549-8829c827ad03 of volume 15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] snapshot_file for this snap is: volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a1f86-1f62-4e45-8501-e924a9cb0289]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (77ee8d9a-bccf-453a-9ad3-465e730683e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330052b4-e5a3-404d-a764-afaeeefee7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330052b4-e5a3-404d-a764-afaeeefee7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481624164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cee35f-21eb-4b50-9a23-9e06f3b5a384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:53Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d14454-fec1-42b3-b852-3e7c4fc73e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d14454-fec1-42b3-b852-3e7c4fc73e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6af1476-914d-46d2-a5c5-f10fe44a5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6af1476-914d-46d2-a5c5-f10fe44a5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63cee35f-21eb-4b50-9a23-9e06f3b5a384', 'volume_name': 'volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e63999-c4c9-42ce-bc41-d9b8eac60235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e63999-c4c9-42ce-bc41-d9b8eac60235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04bd953-8fea-4d58-9dca-dc6973ff0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Volume 63cee35f-21eb-4b50-9a23-9e06f3b5a384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384', 'volume_size': 1} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481624164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cee35f-21eb-4b50-9a23-9e06f3b5a384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:53Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Creating volume 63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:52 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 Sep 29 12:52:52 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:52 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:52 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 1073741824 Sep 29 12:52:52 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:52 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109" returned: 0 in 0.477s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:52 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109 Sep 29 12:52:52 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03" returned: 0 in 0.435s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15c203c6-2d7e-4801-8006-4e049af111c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b4937-c032-442d-80bc-f37d5316124a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:53 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-738ca5ed-6541-4389-bc18-aebf4939f109" returned: 0 in 0.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-738ca5ed-6541-4389-bc18-aebf4939f109" released by "delete_volume" :: held 0.871s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:53 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 Sep 29 12:52:53 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Created reservations ['b70e9eb6-cd5c-4463-b8f6-219abe9ffe73', '445a467a-b9bd-433b-b198-800f2437274c', '029513ea-7614-415b-a0d6-b3b23dd32585', '814c7edc-f3b1-4b98-af00-838e7a7bc896'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:53 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 1073741824" returned: 0 in 0.615s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "cinder-1fee0d0d-4d6d-4694-91d5-e53db0619b43-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:53 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:53 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-1fee0d0d-4d6d-4694-91d5-e53db0619b43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:53 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 Sep 29 12:52:53 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "cinder-quobyte-1fee0d0d-4d6d-4694-91d5-e53db0619b43" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-quobyte-1fee0d0d-4d6d-4694-91d5-e53db0619b43" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b86697-9737-4e7d-a7d6-792ecc5bc297]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:53 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 Sep 29 12:52:53 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:53 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384" returned: 0 in 0.358s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:53 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 Sep 29 12:52:53 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04bd953-8fea-4d58-9dca-dc6973ff0db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:53 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb07a39-ae20-44b5-a425-132b2f0a3134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.521s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:52:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Volume volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 (63cee35f-21eb-4b50-9a23-9e06f3b5a384): created successfully Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb07a39-ae20-44b5-a425-132b2f0a3134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (77ee8d9a-bccf-453a-9ad3-465e730683e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-43e7699f-d6eb-414f-98f5-733516b1f78b tempest-ProjectReaderTests-740467961 None] Created volume successfully. Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eaad8a2e-64f1-4ebc-9445-3e7c21175716 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-738ca5ed-6541-4389-bc18-aebf4939f109-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:54 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (5dcb8067-b559-4136-a0d4-4f6d3442f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8810d7ce-ff37-4240-bdfa-f44410e173cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43" returned: 0 in 0.578s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8810d7ce-ff37-4240-bdfa-f44410e173cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879274203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d095330f-dcf4-471e-bd67-b2e76e8cb581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:54Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:54 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43 Sep 29 12:52:54 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba01e2-fcec-4ae8-8f84-a6d66199cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba01e2-fcec-4ae8-8f84-a6d66199cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7dbbbd-238b-4c51-8eaf-0d0b2be8b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7dbbbd-238b-4c51-8eaf-0d0b2be8b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd095330f-dcf4-471e-bd67-b2e76e8cb581', 'volume_name': 'volume-d095330f-dcf4-471e-bd67-b2e76e8cb581', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b7de71-3bad-4561-832b-f5072660132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b7de71-3bad-4561-832b-f5072660132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81801d67-77b9-4e7d-bb1c-36ec00984677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Volume d095330f-dcf4-471e-bd67-b2e76e8cb581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d095330f-dcf4-471e-bd67-b2e76e8cb581', 'volume_size': 1} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:54 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879274203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d095330f-dcf4-471e-bd67-b2e76e8cb581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:54Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Creating volume d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03" returned: 0 in 0.491s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:54 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 1073741824 Sep 29 12:52:54 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:54 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03 Sep 29 12:52:54 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:54 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1fee0d0d-4d6d-4694-91d5-e53db0619b43" returned: 0 in 0.285s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-quobyte-1fee0d0d-4d6d-4694-91d5-e53db0619b43" released by "delete_volume" :: held 0.968s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Created reservations ['a0cdb97c-02bd-4bc7-a762-9b4ff7b67e61', '03aec1a9-47d9-43e4-9e08-beae044f9e38', '1fdddaba-b5dc-4ea8-9716-b2b8d5873df8', '766817a2-fb97-45f5-8004-9ff23e6c8d97'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:54 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6.cc528965-ecc4-46b7-8549-8829c827ad03" returned: 0 in 0.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-cc528965-ecc4-46b7-8549-8829c827ad03" released by "_delete_snapshot" :: held 2.040s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" released by "delete_snapshot" :: held 2.076s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:54 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:54 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Created reservations ['2be7c166-e29d-428d-ae58-27b86e41ab2c', '8a8e55a2-ee48-4585-b363-c5b61e772181', 'd98f9ec6-4bf9-4583-96c4-3273afcbd8e6', '91c636ff-5ea1-4986-85a6-852de27ba72d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Delete snapshot completed successfully. Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2701879c-cdce-47a6-bf91-9263f208cc8f tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-cc528965-ecc4-46b7-8549-8829c827ad03-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:54 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 1073741824" returned: 0 in 0.568s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:54 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 Sep 29 12:52:54 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:55 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Deleted volume successfully. Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-820df532-4156-4a1c-a53b-bbe2ecdaabb4 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-1fee0d0d-4d6d-4694-91d5-e53db0619b43-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:55 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581" returned: 0 in 0.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.099s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Creating offline snapshot 20f88dd0-6c51-4b23-8aee-6978e475427a of volume 63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81801d67-77b9-4e7d-bb1c-36ec00984677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d095330f-dcf4-471e-bd67-b2e76e8cb581', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aaf64f-09c2-402a-b9dd-61b642cc6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eedefe0-fdd8-4186-9ef0-9dd8fbfa0904]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Volume volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 (d095330f-dcf4-471e-bd67-b2e76e8cb581): created successfully Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aaf64f-09c2-402a-b9dd-61b642cc6051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (5dcb8067-b559-4136-a0d4-4f6d3442f843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-837b3a07-ec78-4733-a4ee-7212e0313977 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:52:55 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 Sep 29 12:52:55 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:55 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:55 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a 1G Sep 29 12:52:55 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-15c203c6-2d7e-4801-8006-4e049af111c6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-15c203c6-2d7e-4801-8006-4e049af111c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7efc9b5-bd1e-42d2-b4b8-fd25c6ffe22b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 Sep 29 12:52:56 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a 1G" returned: 0 in 0.539s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a Sep 29 12:52:56 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Flow 'volume_create_manager' (d319e46f-d890-4b83-82eb-bb587229f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a87db-b6b2-4a9b-b86c-ae4daa61d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a87db-b6b2-4a9b-b86c-ae4daa61d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1245327131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30788fad-8e30-4f8c-8a19-3d719fae98c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b904bd30c74256b27b738fda8427a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:56Z,use_quota=True,user_id='de2925727145489cb9ee8cfb41d3e572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1550939-32a8-4d9b-b4a9-7b356395789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1550939-32a8-4d9b-b4a9-7b356395789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:56 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc13864-bb61-4a10-95c0-1ff445a5df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc13864-bb61-4a10-95c0-1ff445a5df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30788fad-8e30-4f8c-8a19-3d719fae98c7', 'volume_name': 'volume-30788fad-8e30-4f8c-8a19-3d719fae98c7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41618e42-fea2-4986-a768-885e2a701069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41618e42-fea2-4986-a768-885e2a701069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d4512d-4caa-40da-bb60-58a27ad5cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Volume 30788fad-8e30-4f8c-8a19-3d719fae98c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30788fad-8e30-4f8c-8a19-3d719fae98c7', 'volume_size': 1} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6" returned: 0 in 0.504s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6 Sep 29 12:52:56 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:56 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:56 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a is being set with open permissions: ugo+rw Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a Sep 29 12:52:56 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-15c203c6-2d7e-4801-8006-4e049af111c6" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-15c203c6-2d7e-4801-8006-4e049af111c6" released by "delete_volume" :: held 0.849s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Created reservations ['6430064d-2cdb-4268-b493-230c810f3afd', '9ee88824-41b3-4c94-9d17-937b76461983', 'c11de54e-9bc3-481b-b16b-f6c7ece26ebe', '87a167f7-a716-466f-9edf-df28154b975d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:56 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:56 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info Sep 29 12:52:56 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:56 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-1370e74f-cdec-433d-ae0f-df1020054bc1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-1370e74f-cdec-433d-ae0f-df1020054bc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "cinder-quobyte-1370e74f-cdec-433d-ae0f-df1020054bc1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-1370e74f-cdec-433d-ae0f-df1020054bc1" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f48ae23-d884-4119-a682-de9f1c0f2186]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info" returned: 0 in 0.289s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info is being set with open permissions: ugo+rw Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info Sep 29 12:52:57 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:57 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.314s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Deleted volume successfully. Sep 29 12:52:57 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 Sep 29 12:52:57 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f479aa3-70b7-4931-8c59-a9d250d62d57 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-15c203c6-2d7e-4801-8006-4e049af111c6-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:57 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.info" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1245327131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30788fad-8e30-4f8c-8a19-3d719fae98c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b904bd30c74256b27b738fda8427a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:52:56Z,use_quota=True,user_id='de2925727145489cb9ee8cfb41d3e572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Creating volume 30788fad-8e30-4f8c-8a19-3d719fae98c7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:52:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 1073741824 Sep 29 12:52:57 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:57 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e9a3d4c0-04e1-4f00-b54f-a45153e4883c tempest-ProjectReaderTests-740467961 None] Create snapshot completed successfully Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1" returned: 0 in 0.395s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1 Sep 29 12:52:57 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:57 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1370e74f-cdec-433d-ae0f-df1020054bc1" returned: 0 in 0.274s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-quobyte-1370e74f-cdec-433d-ae0f-df1020054bc1" released by "delete_volume" :: held 0.716s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Created reservations ['08bcb814-1404-47b7-8ec5-a2eeb376f1b5', '6cc6f464-a5d4-48d6-a98e-96935e05d13a', '41940390-8364-4891-92a2-beb3bb5e1a3c', '3a051bcf-0ab6-4d5d-90a6-86886f720b74'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:52:57 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 1073741824" returned: 0 in 0.466s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:57 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:52:57 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:57 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 Sep 29 12:52:57 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:58 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:52:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Deleted volume successfully. Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5cab197b-e4fb-407c-87bf-f6a2d6f2ea68 tempest-CinderUnicodeTest-1189343433 None] Lock "cinder-1370e74f-cdec-433d-ae0f-df1020054bc1-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:52:58 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7" returned: 0 in 0.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.731s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d4512d-4caa-40da-bb60-58a27ad5cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30788fad-8e30-4f8c-8a19-3d719fae98c7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1709314a-bebd-49fe-835a-57e877ef4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot cf89eb07-587a-4cd5-bbd4-cc02e91292f3 of volume d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:52:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Volume volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 (30788fad-8e30-4f8c-8a19-3d719fae98c7): created successfully Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1709314a-bebd-49fe-835a-57e877ef4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Flow 'volume_create_manager' (d319e46f-d890-4b83-82eb-bb587229f802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ac676-83e3-43e7-9606-7f59749c450d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ca6b117a-4874-4f64-9f8d-0bfb5b40a829 tempest-ProjectReaderTests-1641402688 None] Created volume successfully. Sep 29 12:52:58 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 Sep 29 12:52:58 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-20f88dd0-6c51-4b23-8aee-6978e475427a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-20f88dd0-6c51-4b23-8aee-6978e475427a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-20f88dd0-6c51-4b23-8aee-6978e475427a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-20f88dd0-6c51-4b23-8aee-6978e475427a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Deleting offline snapshot 20f88dd0-6c51-4b23-8aee-6978e475427a of volume 63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] snapshot_file for this snap is: volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9003c8-6130-44d9-8285-549d53a9b95b]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:58 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:58 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a Sep 29 12:52:58 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581" returned: 0 in 0.433s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:58 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 1G Sep 29 12:52:58 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:58 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b90a6f-7c26-478d-a72f-2818f41a21d0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:59 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 Sep 29 12:52:59 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:59 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 1G" returned: 0 in 0.515s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:59 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 Sep 29 12:52:59 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:59 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384" returned: 0 in 0.473s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "cinder-30788fad-8e30-4f8c-8a19-3d719fae98c7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-30788fad-8e30-4f8c-8a19-3d719fae98c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:59 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a Sep 29 12:52:59 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "cinder-quobyte-30788fad-8e30-4f8c-8a19-3d719fae98c7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:52:59 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3" returned: 0 in 0.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:52:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 is being set with open permissions: ugo+rw Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:59 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 Sep 29 12:52:59 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-quobyte-30788fad-8e30-4f8c-8a19-3d719fae98c7" acquired by "delete_volume" :: waited 0.050s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f240030-daff-4516-b3a4-52f23c37346e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:52:59 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 Sep 29 12:52:59 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:52:59 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 29 12:52:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:00 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a" returned: 0 in 0.532s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:00 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info Sep 29 12:53:00 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:00 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a Sep 29 12:53:00 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:00 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7" returned: 0 in 0.438s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:00 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7 Sep 29 12:53:00 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:00 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info" returned: 0 in 0.338s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info is being set with open permissions: ugo+rw Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:00 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384.20f88dd0-6c51-4b23-8aee-6978e475427a" returned: 0 in 0.320s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info Sep 29 12:53:00 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-20f88dd0-6c51-4b23-8aee-6978e475427a" released by "_delete_snapshot" :: held 1.858s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" released by "delete_snapshot" :: held 1.899s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:00 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-30788fad-8e30-4f8c-8a19-3d719fae98c7" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-quobyte-30788fad-8e30-4f8c-8a19-3d719fae98c7" released by "delete_volume" :: held 0.775s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Created reservations ['bf9236c5-f7f1-4fed-888c-36153fd08026', '8bbae6cd-a1e4-4e55-a0c1-9823119f8dcc', 'e2bb43b1-e997-4dff-9b9d-5f7926f33592', '96adf1a9-0774-4ad1-84b9-69a296ee5a45'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Created reservations ['dd95ea48-4ca1-470e-8c22-c2dc1b929649', '1a8c6cb0-3cf0-48f9-b414-e30a44104b3e', '4418f13f-dc56-4063-895e-9b0a81440692', '37bf46fd-6bcb-4ee0-9252-dce4c3d0dbaa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Delete snapshot completed successfully. Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5eac72b-c218-42ec-9320-f45d424436b1 tempest-ProjectReaderTests-740467961 None] Lock "cinder-20f88dd0-6c51-4b23-8aee-6978e475427a-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:00 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:00 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:00 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.info" returned: 0 in 0.406s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-63cee35f-21eb-4b50-9a23-9e06f3b5a384-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "cinder-63cee35f-21eb-4b50-9a23-9e06f3b5a384-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dbf3a874-527c-4824-8595-addb5ad946d2 tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee37899-adcf-42c4-a81b-59a0dc8f4392]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:01 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.318s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Deleted volume successfully. Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-64c0be11-cb77-4005-906f-2b8dfdcf4ae5 tempest-ProjectReaderTests-1641402688 None] Lock "cinder-30788fad-8e30-4f8c-8a19-3d719fae98c7-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:01 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 Sep 29 12:53:01 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:01 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384" returned: 0 in 0.429s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:01 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384 Sep 29 12:53:01 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:01 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-63cee35f-21eb-4b50-9a23-9e06f3b5a384" returned: 0 in 0.290s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-63cee35f-21eb-4b50-9a23-9e06f3b5a384" released by "delete_volume" :: held 0.812s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-cf89eb07-587a-4cd5-bbd4-cc02e91292f3-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-cf89eb07-587a-4cd5-bbd4-cc02e91292f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-cf89eb07-587a-4cd5-bbd4-cc02e91292f3" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-cf89eb07-587a-4cd5-bbd4-cc02e91292f3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot cf89eb07-587a-4cd5-bbd4-cc02e91292f3 of volume d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Created reservations ['af11e9da-f48c-46c4-8f63-79fb47458956', '09220249-ece7-4d68-97fb-c38d64ec9d46', '1f735c20-bbf5-466c-b0e6-4bc95325f505', '06f711cf-1427-4d9b-9a68-899f8b78ae14'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a628d2-dfcd-44d7-9057-1a9684f070da]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:02 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 Sep 29 12:53:02 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:02 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:02 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:02 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Deleted volume successfully. Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5152687c-ec41-459d-b056-04319575778a tempest-ProjectReaderTests-740467961 None] Lock "cinder-63cee35f-21eb-4b50-9a23-9e06f3b5a384-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:02 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3" returned: 0 in 0.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d095330f-dcf4-471e-bd67-b2e76e8cb581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b7827c-d853-479d-b553-e0ca051f808f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:02 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 Sep 29 12:53:02 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8cd3889-4e92-4910-8812-c727e8cb6bf0 tempest-ProjectAdminTests-647821629 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0428924560547, 'free_capacity_gb': 1775.0428924560547, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (fcdad4fc-1735-4ed7-a873-1e5c23ef5229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7db5ac2-14c4-4946-9895-aa2827f42b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7db5ac2-14c4-4946-9895-aa2827f42b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247578146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb48025-1233-4e99-aade-3d67c43b580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:03Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2eb168-e5ac-4dd8-aca9-bb9e49423a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2eb168-e5ac-4dd8-aca9-bb9e49423a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464d7d-6cd6-483e-a136-667303a73090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464d7d-6cd6-483e-a136-667303a73090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb48025-1233-4e99-aade-3d67c43b580e', 'volume_name': 'volume-eeb48025-1233-4e99-aade-3d67c43b580e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c88e00-83d8-4c79-94e0-ccb6b93b8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c88e00-83d8-4c79-94e0-ccb6b93b8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cc332b-18b3-4684-af36-c2bfc33e8b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Volume eeb48025-1233-4e99-aade-3d67c43b580e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb48025-1233-4e99-aade-3d67c43b580e', 'volume_size': 1} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247578146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb48025-1233-4e99-aade-3d67c43b580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:03Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Creating volume eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:02 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e 1073741824 Sep 29 12:53:02 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:02 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581" returned: 0 in 0.505s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:03 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 Sep 29 12:53:03 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:03 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3" returned: 0 in 0.427s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:03 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3 Sep 29 12:53:03 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:03 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e 1073741824" returned: 0 in 0.621s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:03 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e Sep 29 12:53:03 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:03 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581.cf89eb07-587a-4cd5-bbd4-cc02e91292f3" returned: 0 in 0.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-cf89eb07-587a-4cd5-bbd4-cc02e91292f3" released by "_delete_snapshot" :: held 1.968s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" released by "delete_snapshot" :: held 2.000s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:03 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e" returned: 0 in 0.303s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cc332b-18b3-4684-af36-c2bfc33e8b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb48025-1233-4e99-aade-3d67c43b580e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518a1d8b-df91-4e96-8da1-e9dd14faef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Created reservations ['36eb2088-2f2f-495c-872f-547b43532dae', '11d939b1-3570-45b4-81ab-96ccb5f6f87a', '8bede7e7-c61a-48c4-a698-286096290bbc', '1a4ff8ed-f839-48cc-bc17-9a2c9198599b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Volume volume-eeb48025-1233-4e99-aade-3d67c43b580e (eeb48025-1233-4e99-aade-3d67c43b580e): created successfully Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518a1d8b-df91-4e96-8da1-e9dd14faef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (fcdad4fc-1735-4ed7-a873-1e5c23ef5229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-028fe59c-7ab2-4c2b-9a13-85419f3e5d76 tempest-ProjectReaderTests-740467961 None] Created volume successfully. Sep 29 12:53:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-72293012-a414-4c8a-a5a6-4a75e6754468 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-cf89eb07-587a-4cd5-bbd4-cc02e91292f3-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-d095330f-dcf4-471e-bd67-b2e76e8cb581-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "cinder-d095330f-dcf4-471e-bd67-b2e76e8cb581-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Creating offline snapshot f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 of volume eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[159eea00-5271-426c-82e8-0cb60a0d8b7a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb65bd76-0d98-4095-917a-31d5af91ab07]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:05 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e Sep 29 12:53:05 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:05 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 Sep 29 12:53:05 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:05 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e" returned: 0 in 0.500s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:05 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 1G Sep 29 12:53:05 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:05 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581" returned: 0 in 0.509s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:05 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581 Sep 29 12:53:05 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:06 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d095330f-dcf4-471e-bd67-b2e76e8cb581" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d095330f-dcf4-471e-bd67-b2e76e8cb581" released by "delete_volume" :: held 0.955s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Created reservations ['74ba4670-447f-4bb6-990f-1be7dc484b36', 'c5dbf8cb-8fce-4fc8-a2b0-5df5f9229acc', '8806d16d-6b0a-4c6e-a8f8-3e9060cf2ba1', 'c7841a50-718d-4265-a6a1-2737c83b213d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:06 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 1G" returned: 0 in 0.576s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeb48025-1233-4e99-aade-3d67c43b580e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:06 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeb48025-1233-4e99-aade-3d67c43b580e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 Sep 29 12:53:06 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:06 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:06 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeb48025-1233-4e99-aade-3d67c43b580e -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:06 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 is being set with open permissions: ugo+rw Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:06 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.321s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:06 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 Sep 29 12:53:06 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a763ab-ccb3-4e7f-a7e2-6aba1257476a tempest-ProjectMemberTests-1564258649 None] Lock "cinder-d095330f-dcf4-471e-bd67-b2e76e8cb581-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:06 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:07 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info Sep 29 12:53:07 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info" returned: 0 in 0.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:07 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info is being set with open permissions: ugo+rw Sep 29 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:07 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info Sep 29 12:53:07 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:07 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.info" returned: 0 in 0.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-32fdd98a-af81-4e48-bd5c-5c771dd7d4b0 tempest-ProjectReaderTests-740467961 None] Create snapshot completed successfully Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (a90796cc-67c1-42f1-937b-090eb944d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccfaaa-bfdc-4bf3-9f8f-175515107a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccfaaa-bfdc-4bf3-9f8f-175515107a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542711263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f0ac7d-1675-4a1f-ab70-8a4784a30290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:08Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55c4803-b237-4036-bd58-82bee47efe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55c4803-b237-4036-bd58-82bee47efe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e41778f-1446-435c-afdb-2ef30dd0e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e41778f-1446-435c-afdb-2ef30dd0e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f0ac7d-1675-4a1f-ab70-8a4784a30290', 'volume_name': 'volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3ed2df-8c86-4477-bdaf-46bbf3d522aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3ed2df-8c86-4477-bdaf-46bbf3d522aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7565d12-7c19-4f91-bb70-ef9d184c9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Volume 40f0ac7d-1675-4a1f-ab70-8a4784a30290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290', 'volume_size': 1} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542711263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f0ac7d-1675-4a1f-ab70-8a4784a30290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:08Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Creating volume 40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:08 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:08 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 1073741824 Sep 29 12:53:08 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Deleting offline snapshot f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 of volume eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] snapshot_file for this snap is: volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e1d4d1-a1f7-45d0-b78b-145d6ccd4c53]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:08 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 Sep 29 12:53:08 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:08 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 1073741824" returned: 0 in 0.524s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:08 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 Sep 29 12:53:08 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:08 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" returned: 0 in 0.495s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeb48025-1233-4e99-aade-3d67c43b580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3e4695-9ff8-48b1-88c8-5c2d94e0ed26]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:09 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290" returned: 0 in 0.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:09 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e Sep 29 12:53:09 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7565d12-7c19-4f91-bb70-ef9d184c9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc746528-b63a-4e3c-8e0f-ea4ef7c31e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Volume volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 (40f0ac7d-1675-4a1f-ab70-8a4784a30290): created successfully Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc746528-b63a-4e3c-8e0f-ea4ef7c31e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (a90796cc-67c1-42f1-937b-090eb944d131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-26210a44-dff9-4396-a65f-cc423d5f0457 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:09 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e" returned: 0 in 0.463s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:09 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 Sep 29 12:53:09 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:09 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" returned: 0 in 0.438s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:09 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3 Sep 29 12:53:09 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:10 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e.f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" returned: 0 in 0.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3" released by "_delete_snapshot" :: held 1.911s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" released by "delete_snapshot" :: held 1.940s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot 59bd22d8-4b88-4b54-9b5a-f4278bd17a07 of volume 40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7323d2-b04a-4ce8-8428-c1d242c54d99]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Created reservations ['7969821e-24ea-41d5-971b-63874a53df52', '439865bf-e9ec-480b-b806-e66d11aa5d24', '04812108-ab30-4f3c-9698-187aa7c896c3', '471925a6-c791-44c5-96e3-49aa7abeec40'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Delete snapshot completed successfully. Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-59c9df63-61f7-46ed-abfc-7954d9146e44 tempest-ProjectReaderTests-740467961 None] Lock "cinder-f7fc5bde-c7c6-4e3b-9540-1a9cf09ec2e3-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:10 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 Sep 29 12:53:10 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:10 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:10 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 1G Sep 29 12:53:10 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:11 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 1G" returned: 0 in 0.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:11 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 Sep 29 12:53:11 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:11 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 is being set with open permissions: ugo+rw Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:11 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 Sep 29 12:53:11 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-eeb48025-1233-4e99-aade-3d67c43b580e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "cinder-eeb48025-1233-4e99-aade-3d67c43b580e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b878c9f6-df70-400a-88d9-b6df3c692911]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:11 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07" returned: 0 in 0.289s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:11 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e Sep 29 12:53:11 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:11 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info Sep 29 12:53:11 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:12 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info" returned: 0 in 0.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:12 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info is being set with open permissions: ugo+rw Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:12 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e" returned: 0 in 0.434s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:12 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info Sep 29 12:53:12 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:12 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e Sep 29 12:53:12 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:12 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.info" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:12 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-eeb48025-1233-4e99-aade-3d67c43b580e" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6cdff4e9-ade2-49af-9a55-2011efd24b77 tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-eeb48025-1233-4e99-aade-3d67c43b580e" released by "delete_volume" :: held 0.769s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Created reservations ['e342c209-dee2-437c-ac48-52ec46e9e737', 'c2d25646-bc97-4125-96cc-11317fa47bb8', '375077b7-3428-4e4b-8467-09839f52744d', 'dfab4c19-e9fd-444f-94a6-3f2565c2745c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:12 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:12 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:12 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Deleted volume successfully. Sep 29 12:53:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b22c81e8-6a0c-41c9-970a-a418ab120ac6 tempest-ProjectReaderTests-740467961 None] Lock "cinder-eeb48025-1233-4e99-aade-3d67c43b580e-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (e3b17996-c226-49e8-909a-556ee4c8be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a178e1a-dc61-43f3-9384-f20cb78aeebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a178e1a-dc61-43f3-9384-f20cb78aeebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291269685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4115cf38-920f-48cd-855c-fd87461efc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:13Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f984a9f-f276-4004-87d4-487ff862b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f984a9f-f276-4004-87d4-487ff862b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df25e2-1034-4d27-9de9-4923714b3327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df25e2-1034-4d27-9de9-4923714b3327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4115cf38-920f-48cd-855c-fd87461efc6c', 'volume_name': 'volume-4115cf38-920f-48cd-855c-fd87461efc6c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc89195-7e7d-4eee-b3d8-2e6ff4e3f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc89195-7e7d-4eee-b3d8-2e6ff4e3f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2e45bc-9ef5-4154-b218-97eccb6d6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Volume 4115cf38-920f-48cd-855c-fd87461efc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4115cf38-920f-48cd-855c-fd87461efc6c', 'volume_size': 1} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291269685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4115cf38-920f-48cd-855c-fd87461efc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:13Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Creating volume 4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:13 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:13 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c 1073741824 Sep 29 12:53:13 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-59bd22d8-4b88-4b54-9b5a-f4278bd17a07-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-59bd22d8-4b88-4b54-9b5a-f4278bd17a07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-59bd22d8-4b88-4b54-9b5a-f4278bd17a07" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-59bd22d8-4b88-4b54-9b5a-f4278bd17a07" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot 59bd22d8-4b88-4b54-9b5a-f4278bd17a07 of volume 40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0710f-1f1f-473f-8566-36ddf9dad4f0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:13 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 Sep 29 12:53:13 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:13 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c 1073741824" returned: 0 in 0.543s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:13 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c Sep 29 12:53:13 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:13 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07" returned: 0 in 0.451s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5628185-3252-4678-8bb3-22c9cbe09054]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:14 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:14 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:14 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2e45bc-9ef5-4154-b218-97eccb6d6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4115cf38-920f-48cd-855c-fd87461efc6c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297996c-23df-46bd-ba21-72d5cbbfd7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Volume volume-4115cf38-920f-48cd-855c-fd87461efc6c (4115cf38-920f-48cd-855c-fd87461efc6c): created successfully Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297996c-23df-46bd-ba21-72d5cbbfd7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (e3b17996-c226-49e8-909a-556ee4c8be87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d7e523f7-4e68-45af-966c-6787c105e9fe tempest-ProjectReaderTests-740467961 None] Created volume successfully. Sep 29 12:53:14 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290" returned: 0 in 0.414s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:14 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 Sep 29 12:53:14 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:14 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07" returned: 0 in 0.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:14 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07 Sep 29 12:53:14 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:15 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290.59bd22d8-4b88-4b54-9b5a-f4278bd17a07" returned: 0 in 0.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-59bd22d8-4b88-4b54-9b5a-f4278bd17a07" released by "_delete_snapshot" :: held 1.650s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" released by "delete_snapshot" :: held 1.678s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Created reservations ['5e0814e4-dafd-4fff-a5b6-1d1a33e8a48b', 'fbf9c1eb-9cee-4d08-9034-75735bedfa56', '53489972-18f5-4967-899b-28c185a23151', 'f460b67b-f5da-4829-9283-453b9cf8d873'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7666f9e4-3655-4cb4-bb1b-393806f655e0 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-59bd22d8-4b88-4b54-9b5a-f4278bd17a07-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Creating offline snapshot 12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 of volume 4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9474ca5-52be-4905-8a39-82138c2f9256]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-40f0ac7d-1675-4a1f-ab70-8a4784a30290-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:15 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c Sep 29 12:53:15 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-40f0ac7d-1675-4a1f-ab70-8a4784a30290-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[92121cec-2be8-4d65-9798-64f42411f18d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:15 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 Sep 29 12:53:15 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:15 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:15 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 1G Sep 29 12:53:15 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:16 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290" returned: 0 in 0.382s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:16 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290 Sep 29 12:53:16 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:16 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 1G" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115cf38-920f-48cd-855c-fd87461efc6c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:16 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115cf38-920f-48cd-855c-fd87461efc6c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 Sep 29 12:53:16 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:16 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-40f0ac7d-1675-4a1f-ab70-8a4784a30290" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-40f0ac7d-1675-4a1f-ab70-8a4784a30290" released by "delete_volume" :: held 0.702s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Created reservations ['c4a0d5a9-932d-4ae2-a8cc-8391b2e44bfa', 'd3a35fc1-30be-49d6-9f23-3374e456659c', 'eef97262-b9db-4d2e-8094-ebb0dee23543', '6c684796-55fd-46e8-beee-077fd4d8b176'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:16 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:16 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:16 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115cf38-920f-48cd-855c-fd87461efc6c -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" returned: 0 in 0.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 is being set with open permissions: ugo+rw Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:16 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 Sep 29 12:53:16 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:16 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-90cea0a0-87db-4a33-ba17-4c5768d75b7d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-40f0ac7d-1675-4a1f-ab70-8a4784a30290-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:16 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:16 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info Sep 29 12:53:16 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:17 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info" returned: 0 in 0.276s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:17 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info is being set with open permissions: ugo+rw Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:17 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info Sep 29 12:53:17 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (82a55899-1bdb-425d-a688-a91ab9b6499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c34c90-ed2f-4051-8152-826ce214c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c34c90-ed2f-4051-8152-826ce214c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673182907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd2fa5a-b084-4661-a1b8-c90369536cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:17Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626085da-a70c-4cd6-a3b8-cb02d2d07219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626085da-a70c-4cd6-a3b8-cb02d2d07219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8caa46-dc59-475d-a897-9dfdc7cc6fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8caa46-dc59-475d-a897-9dfdc7cc6fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd2fa5a-b084-4661-a1b8-c90369536cbe', 'volume_name': 'volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150e1dd6-45c9-4599-87d2-8361451e0cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150e1dd6-45c9-4599-87d2-8361451e0cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8ba090-7c3f-45e8-97d2-623867a0b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Volume fcd2fa5a-b084-4661-a1b8-c90369536cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe', 'volume_size': 1} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:17 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.info" returned: 0 in 0.251s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673182907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd2fa5a-b084-4661-a1b8-c90369536cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:17Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Creating volume fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:17 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe 1073741824 Sep 29 12:53:17 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ee40856-8e7f-4c14-97fc-04c6f1ed3214 tempest-ProjectReaderTests-740467961 None] Create snapshot completed successfully Sep 29 12:53:17 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe 1073741824" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:17 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe Sep 29 12:53:17 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:18 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe" returned: 0 in 0.254s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8ba090-7c3f-45e8-97d2-623867a0b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771415f7-fcc7-4b51-8803-e3fcffcd850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Volume volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe (fcd2fa5a-b084-4661-a1b8-c90369536cbe): created successfully Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771415f7-fcc7-4b51-8803-e3fcffcd850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (82a55899-1bdb-425d-a688-a91ab9b6499d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4fb8665a-d0d4-4469-964b-57e28bb5fc76 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Deleting offline snapshot 12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 of volume 4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] snapshot_file for this snap is: volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7985c6d-a271-4076-a3dc-ac9c81b67951]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:18 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 Sep 29 12:53:18 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:19 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4115cf38-920f-48cd-855c-fd87461efc6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c2b598-9e75-48c6-bec9-c9ad363956f2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:19 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c Sep 29 12:53:19 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot 00484e5e-b0b3-4a36-909c-55df3e56a9f4 of volume fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc73154-2be5-47af-86cd-d4081078887f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:19 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c" returned: 0 in 0.444s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:19 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 Sep 29 12:53:19 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:19 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe Sep 29 12:53:19 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:19 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:19 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:19 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 1G Sep 29 12:53:19 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:19 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8 Sep 29 12:53:19 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:20 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c.12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8" released by "_delete_snapshot" :: held 1.529s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" released by "delete_snapshot" :: held 1.551s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Created reservations ['480989a7-b8cb-4f15-9000-f3d56418f66e', 'f7e02622-1214-42e7-832d-1dec10ec6a35', '23ac5770-8434-4683-95fb-a0deb05bbd14', '06b48518-75d9-4a47-b78a-caa8bb00ca39'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Delete snapshot completed successfully. Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0f4627b1-a4b5-468e-b5b8-3be6b4e60474 tempest-ProjectReaderTests-740467961 None] Lock "cinder-12b2edf7-b2f2-423f-9d02-fb7b6bd462a8-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:20 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 1G" returned: 0 in 0.455s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:20 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 Sep 29 12:53:20 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:20 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4" returned: 0 in 0.302s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:20 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 is being set with open permissions: ugo+rw Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:20 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 Sep 29 12:53:20 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-4115cf38-920f-48cd-855c-fd87461efc6c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "cinder-4115cf38-920f-48cd-855c-fd87461efc6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:20 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0255c48b-bbd9-4944-8668-2af39766058c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:21 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info Sep 29 12:53:21 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:21 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c Sep 29 12:53:21 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:21 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:21 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info is being set with open permissions: ugo+rw Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:21 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info Sep 29 12:53:21 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:21 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c" returned: 0 in 0.373s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:21 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c Sep 29 12:53:21 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:21 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.info" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3420702a-02d4-4b71-82ff-d88a5524d3a1 tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:21 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-4115cf38-920f-48cd-855c-fd87461efc6c" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-4115cf38-920f-48cd-855c-fd87461efc6c" released by "delete_volume" :: held 0.714s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Created reservations ['3b737a18-45c1-49e4-a917-3045b3c2ce1d', '6c76f8da-0fbe-4f17-9da5-e6a74983431e', 'e8f2f46e-28c5-458f-aa02-12f302a2bf4d', '56d48291-9faf-465f-a42c-7d1a703fc511'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:21 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:21 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:21 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.254s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Deleted volume successfully. Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3a5cdb8b-46d9-48bf-b247-2d6e7ac4543d tempest-ProjectReaderTests-740467961 None] Lock "cinder-4115cf38-920f-48cd-855c-fd87461efc6c-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (902c7117-b679-49eb-9cde-65d449d65859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f18f65-9a74-4298-8670-a954a76ec117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f18f65-9a74-4298-8670-a954a76ec117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770856270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f073e2e-6e3a-448a-b030-87567e7ab873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:22Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489e7c58-6e20-43e9-8c21-30630e3998f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489e7c58-6e20-43e9-8c21-30630e3998f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e45cb-891a-4175-bc83-0dfa78fdc0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e45cb-891a-4175-bc83-0dfa78fdc0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f073e2e-6e3a-448a-b030-87567e7ab873', 'volume_name': 'volume-3f073e2e-6e3a-448a-b030-87567e7ab873', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2222fb-7612-4a31-bfe4-d777e8d274ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2222fb-7612-4a31-bfe4-d777e8d274ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e9e938-df02-46e0-969a-4871536e480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Volume 3f073e2e-6e3a-448a-b030-87567e7ab873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f073e2e-6e3a-448a-b030-87567e7ab873', 'volume_size': 1} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770856270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f073e2e-6e3a-448a-b030-87567e7ab873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:22Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Creating volume 3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:22 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:22 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 1073741824 Sep 29 12:53:22 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-00484e5e-b0b3-4a36-909c-55df3e56a9f4-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-00484e5e-b0b3-4a36-909c-55df3e56a9f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-00484e5e-b0b3-4a36-909c-55df3e56a9f4" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-00484e5e-b0b3-4a36-909c-55df3e56a9f4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot 00484e5e-b0b3-4a36-909c-55df3e56a9f4 of volume fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db68bc-a440-48ba-94f9-3fb01b7d3d88]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:22 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 Sep 29 12:53:22 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:23 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 1073741824" returned: 0 in 0.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:23 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 Sep 29 12:53:23 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:23 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4" returned: 0 in 0.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7909bd88-84c7-47f9-a650-cbac73f26585]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:23 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:23 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe Sep 29 12:53:23 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873" returned: 0 in 0.245s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e9e938-df02-46e0-969a-4871536e480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f073e2e-6e3a-448a-b030-87567e7ab873', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1037b1ec-4bda-422c-a0be-21a23786d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Volume volume-3f073e2e-6e3a-448a-b030-87567e7ab873 (3f073e2e-6e3a-448a-b030-87567e7ab873): created successfully Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1037b1ec-4bda-422c-a0be-21a23786d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (902c7117-b679-49eb-9cde-65d449d65859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ca09800d-8f87-45dd-a11e-141a31e74849 tempest-ProjectReaderTests-740467961 None] Created volume successfully. Sep 29 12:53:23 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe" returned: 0 in 0.421s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:23 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 Sep 29 12:53:23 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Creating offline snapshot c58752c0-fbf9-44fd-aeb1-36d167f4a752 of volume 3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e4982c-7a66-4cec-8422-3d678685c8dd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:23 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 Sep 29 12:53:23 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:23 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4" returned: 0 in 0.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:23 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4 Sep 29 12:53:23 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:24 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873" returned: 0 in 0.372s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:24 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 1G Sep 29 12:53:24 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:24 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe.00484e5e-b0b3-4a36-909c-55df3e56a9f4" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-00484e5e-b0b3-4a36-909c-55df3e56a9f4" released by "_delete_snapshot" :: held 1.527s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" released by "delete_snapshot" :: held 1.556s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Created reservations ['8c507bd6-0e40-4a0d-a2df-f83bffd6b0df', 'f75bc4b4-0c37-4280-b9d1-56d1915092fd', '8935f273-4cda-48a1-9bd4-fdca149ca8ee', '9c7f68b4-a73f-4535-b1ff-4574607451ad'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a17b59df-8a43-4933-85ed-d147bbf33edc tempest-ProjectMemberTests-1564258649 None] Lock "cinder-00484e5e-b0b3-4a36-909c-55df3e56a9f4-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:24 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 1G" returned: 0 in 0.446s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f073e2e-6e3a-448a-b030-87567e7ab873 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:24 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f073e2e-6e3a-448a-b030-87567e7ab873 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 Sep 29 12:53:24 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-fcd2fa5a-b084-4661-a1b8-c90369536cbe-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-fcd2fa5a-b084-4661-a1b8-c90369536cbe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:24 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f073e2e-6e3a-448a-b030-87567e7ab873 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752" returned: 0 in 0.310s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:24 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 is being set with open permissions: ugo+rw Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:24 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 Sep 29 12:53:24 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1105f419-375a-4825-ac89-8a403d884859]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:25 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe Sep 29 12:53:25 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:25 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752" returned: 0 in 0.249s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:25 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info Sep 29 12:53:25 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:25 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe" returned: 0 in 0.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:25 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe Sep 29 12:53:25 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:25 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:25 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info is being set with open permissions: ugo+rw Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:25 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info Sep 29 12:53:25 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:25 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-fcd2fa5a-b084-4661-a1b8-c90369536cbe" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-fcd2fa5a-b084-4661-a1b8-c90369536cbe" released by "delete_volume" :: held 0.719s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:25 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.info" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-69efe53c-a1b0-41e7-b9b2-020c055bf857 tempest-ProjectReaderTests-740467961 None] Create snapshot completed successfully Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Created reservations ['3a8d6691-2cf8-432a-83ef-ec812d464a58', '50180dbd-9142-42b9-9992-1e03576ec7e4', 'dd76a170-728a-43a5-b09b-fe9b2f0e864c', 'a3af6995-0254-4b4c-8bd8-d1c1bdfdffaf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:25 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:25 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:26 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.255s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab4a8961-f7b6-410b-8933-ea22ec989c3d tempest-ProjectMemberTests-1564258649 None] Lock "cinder-fcd2fa5a-b084-4661-a1b8-c90369536cbe-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (32b23dad-1e40-44f3-a1aa-da1ea1fc0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403133ed-e141-4cd4-8f7b-b77b65aa49eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403133ed-e141-4cd4-8f7b-b77b65aa49eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170834018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a214588-2f13-4933-afcc-11977de16918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:26Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d011d96d-648d-47d4-a94d-aebbbc4fe705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d011d96d-648d-47d4-a94d-aebbbc4fe705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c2f74-3052-40bb-bb80-42077e927e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c2f74-3052-40bb-bb80-42077e927e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a214588-2f13-4933-afcc-11977de16918', 'volume_name': 'volume-5a214588-2f13-4933-afcc-11977de16918', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22959f6-1f5e-4c12-9d01-d2ecb0328cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22959f6-1f5e-4c12-9d01-d2ecb0328cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb090c8-94c7-4e9e-9b5f-a41c34419188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Volume 5a214588-2f13-4933-afcc-11977de16918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a214588-2f13-4933-afcc-11977de16918', 'volume_size': 1} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170834018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a214588-2f13-4933-afcc-11977de16918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:26Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Creating volume 5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:26 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 1073741824 Sep 29 12:53:26 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-c58752c0-fbf9-44fd-aeb1-36d167f4a752-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-c58752c0-fbf9-44fd-aeb1-36d167f4a752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-c58752c0-fbf9-44fd-aeb1-36d167f4a752" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-c58752c0-fbf9-44fd-aeb1-36d167f4a752" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Deleting offline snapshot c58752c0-fbf9-44fd-aeb1-36d167f4a752 of volume 3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] snapshot_file for this snap is: volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0373ef2-8318-453f-bd58-783e252ac2e0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:26 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 1073741824" returned: 0 in 0.498s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:27 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 Sep 29 12:53:27 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:27 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 Sep 29 12:53:27 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:27 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918" returned: 0 in 0.258s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb090c8-94c7-4e9e-9b5f-a41c34419188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a214588-2f13-4933-afcc-11977de16918', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a713873-dd59-43e6-b0d5-f4030d679a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Volume volume-5a214588-2f13-4933-afcc-11977de16918 (5a214588-2f13-4933-afcc-11977de16918): created successfully Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a713873-dd59-43e6-b0d5-f4030d679a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (32b23dad-1e40-44f3-a1aa-da1ea1fc0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f2f93528-5cd2-4b1f-b2c8-6a4895e2f2a4 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:27 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752" returned: 0 in 0.404s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f073e2e-6e3a-448a-b030-87567e7ab873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b6d793-58ee-4a03-bd03-c7f4b1ac9271]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:27 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 Sep 29 12:53:27 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:27 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873" returned: 0 in 0.361s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:27 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 Sep 29 12:53:27 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:28 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752" returned: 0 in 0.326s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:28 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752 Sep 29 12:53:28 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:28 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873.c58752c0-fbf9-44fd-aeb1-36d167f4a752" returned: 0 in 0.241s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-c58752c0-fbf9-44fd-aeb1-36d167f4a752" released by "_delete_snapshot" :: held 1.436s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" released by "delete_snapshot" :: held 1.457s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Created reservations ['252ad0e2-38ea-4e50-ab9b-cdb9e0b41d43', '1adddee1-41af-4a98-9dc7-1d2c740719cd', '0adf6962-766f-4b3a-8032-61ae0421476b', '14fe4aca-7aa4-42b5-b3a6-b15fedc43154'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Delete snapshot completed successfully. Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd737f05-b71a-4f40-b13d-9358ff51cd31 tempest-ProjectReaderTests-740467961 None] Lock "cinder-c58752c0-fbf9-44fd-aeb1-36d167f4a752-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 of volume 5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c1f5b-a579-47b1-b528-7ed83a8c34a2]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:28 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 Sep 29 12:53:28 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-3f073e2e-6e3a-448a-b030-87567e7ab873-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "cinder-3f073e2e-6e3a-448a-b030-87567e7ab873-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:29 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918" returned: 0 in 0.387s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:29 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 1G Sep 29 12:53:29 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece0939-2f30-4f71-bc80-519663ebaf8c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:29 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 Sep 29 12:53:29 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 1G" returned: 0 in 0.444s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a214588-2f13-4933-afcc-11977de16918 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:29 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a214588-2f13-4933-afcc-11977de16918 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 Sep 29 12:53:29 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873" returned: 0 in 0.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:29 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873 Sep 29 12:53:29 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a214588-2f13-4933-afcc-11977de16918 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 is being set with open permissions: ugo+rw Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:29 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-3f073e2e-6e3a-448a-b030-87567e7ab873" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:29 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 Sep 29 12:53:29 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-3f073e2e-6e3a-448a-b030-87567e7ab873" released by "delete_volume" :: held 0.744s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Created reservations ['0ba8a3ce-abc0-4c5a-aeac-905e89619f1e', '588aa50a-2d08-4f51-8b72-2a61c985ab66', '10b49ff7-c6d3-41b6-83bb-2f663963794d', '63723ee5-f00e-4900-a9ec-4f3770958e53'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:30 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:30 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:30 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" returned: 0 in 0.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:30 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info Sep 29 12:53:30 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:30 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:30 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:30 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Deleted volume successfully. Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-500d9a24-98d3-4fbc-944e-e84c7865ab09 tempest-ProjectReaderTests-740467961 None] Lock "cinder-3f073e2e-6e3a-448a-b030-87567e7ab873-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:30 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info" returned: 0 in 0.315s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info is being set with open permissions: ugo+rw Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:30 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info Sep 29 12:53:30 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:30 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.287s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:30 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (979dc4b0-3945-426a-ae5c-745c46158e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8b0502-b232-42d4-aec7-93cf271e5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.info" returned: 0 in 0.306s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8b0502-b232-42d4-aec7-93cf271e5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1663342012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e797b5b9-ced1-4a2b-b44a-3c8bdea67492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:31Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ce13a4-7953-48d6-a3ed-15b0a3baffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ce13a4-7953-48d6-a3ed-15b0a3baffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e212d4fc-be2c-478c-b36c-5c4b123d047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e212d4fc-be2c-478c-b36c-5c4b123d047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e797b5b9-ced1-4a2b-b44a-3c8bdea67492', 'volume_name': 'volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e52ff48-0119-4832-9c01-c1592d66e4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e52ff48-0119-4832-9c01-c1592d66e4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c558db8-d123-49a1-a662-b8ee7e619e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Volume e797b5b9-ced1-4a2b-b44a-3c8bdea67492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492', 'volume_size': 1} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1663342012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e797b5b9-ced1-4a2b-b44a-3c8bdea67492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7384a3298f549cdac3099f352f04db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:31Z,use_quota=True,user_id='e1c07b36eb4844b1b12f3985be67182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Creating volume e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:30 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:30 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 1073741824 Sep 29 12:53:30 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-58eca757-31ca-48bc-a3ed-1eeb0dc9b49a tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:31 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 1073741824" returned: 0 in 0.411s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:31 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 Sep 29 12:53:31 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:31 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" returned: 0 in 0.244s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c558db8-d123-49a1-a662-b8ee7e619e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0232823-a9b8-4d69-bba0-977d46bca896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Volume volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 (e797b5b9-ced1-4a2b-b44a-3c8bdea67492): created successfully Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0232823-a9b8-4d69-bba0-977d46bca896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Flow 'volume_create_manager' (979dc4b0-3945-426a-ae5c-745c46158e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e7452811-c63c-44db-9df8-57771da269b0 tempest-ProjectReaderTests-740467961 None] Created volume successfully. Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 of volume 5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5085a-42ee-4889-904f-8919bb28c041]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Creating offline snapshot 6b60ddd5-f02c-4384-ac71-98b19d541d8a of volume e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcedfa-6a0b-4328-9757-e75b5ac23dfd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:32 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 Sep 29 12:53:32 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:32 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 Sep 29 12:53:32 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:32 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" returned: 0 in 0.383s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a214588-2f13-4933-afcc-11977de16918(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b37c80-0f4f-4dfd-abfa-39ca9520c0a8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:32 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:32 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a 1G Sep 29 12:53:32 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:32 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 Sep 29 12:53:32 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:32 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918" returned: 0 in 0.410s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:32 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 Sep 29 12:53:32 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:32 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a 1G" returned: 0 in 0.442s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:32 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a Sep 29 12:53:32 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:33 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" returned: 0 in 0.349s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:33 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a" returned: 0 in 0.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a is being set with open permissions: ugo+rw Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:33 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387 Sep 29 12:53:33 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:33 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a Sep 29 12:53:33 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:33 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a" returned: 0 in 0.237s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918.b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" returned: 0 in 0.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387" released by "_delete_snapshot" :: held 1.509s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" released by "delete_snapshot" :: held 1.540s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:33 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info Sep 29 12:53:33 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Created reservations ['e2038701-4fb7-49c6-a20b-95ad5174dd13', '1f711baa-3332-47c7-83a7-57894945fe38', '96f9a886-0ec8-4261-b268-dea3739ea1dc', 'e7b49bdb-e9d3-4aac-aeff-446361a15d36'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15223553-e7f2-48a3-886b-73cc4c3bd82c tempest-ProjectMemberTests-1564258649 None] Lock "cinder-b8c76e1e-1e1f-4bb1-a1a4-37fe125ce387-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:33 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info is being set with open permissions: ugo+rw Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:33 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info Sep 29 12:53:33 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:33 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.info" returned: 0 in 0.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-5a214588-2f13-4933-afcc-11977de16918-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b252f56c-93fe-4b77-8ef1-cae89d24c45f tempest-ProjectReaderTests-740467961 None] Create snapshot completed successfully Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-5a214588-2f13-4933-afcc-11977de16918-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ebf2e9-dd8e-46d5-96e9-08d754381d49]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:34 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 Sep 29 12:53:34 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:34 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918" returned: 0 in 0.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:34 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918 Sep 29 12:53:34 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:34 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5a214588-2f13-4933-afcc-11977de16918" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5a214588-2f13-4933-afcc-11977de16918" released by "delete_volume" :: held 0.670s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Created reservations ['56141614-b840-4da9-811e-bcdae9f432f1', '29ed0cb5-08db-488d-ac1a-a79511c0d0df', '76926e61-3936-46ad-a79d-503d8693cc37', 'a81d48c8-1482-4e5e-b9bb-6e2c6040655d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:34 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:34 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-6b60ddd5-f02c-4384-ac71-98b19d541d8a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-6b60ddd5-f02c-4384-ac71-98b19d541d8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-6b60ddd5-f02c-4384-ac71-98b19d541d8a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-6b60ddd5-f02c-4384-ac71-98b19d541d8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:35 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Deleting offline snapshot 6b60ddd5-f02c-4384-ac71-98b19d541d8a of volume e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] snapshot_file for this snap is: volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d67a052-0aa6-4dca-98e7-648312790870]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7453242a-56a6-4e66-b363-cad047f993f5 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-5a214588-2f13-4933-afcc-11977de16918-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:35 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a Sep 29 12:53:35 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:35 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969f781-9233-42fc-ab47-d13a6ba1c255]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (00c0b5e7-2b82-48e0-94e0-d92016cd5eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55220da2-c8be-4b5d-8738-033e561ab9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55220da2-c8be-4b5d-8738-033e561ab9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607884230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c6e82c-0c97-4d11-943c-782d72024706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:36Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e35b427-ab50-4a58-9e0c-b576f691c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e35b427-ab50-4a58-9e0c-b576f691c238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e612d36c-90b4-477b-8fc8-0bd894bf68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e612d36c-90b4-477b-8fc8-0bd894bf68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c6e82c-0c97-4d11-943c-782d72024706', 'volume_name': 'volume-55c6e82c-0c97-4d11-943c-782d72024706', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d333289-c18c-4197-903c-e4562b3f5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d333289-c18c-4197-903c-e4562b3f5c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:35 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 Sep 29 12:53:35 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cbefdb-4be5-4e7f-8019-a4d2887a260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Volume 55c6e82c-0c97-4d11-943c-782d72024706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c6e82c-0c97-4d11-943c-782d72024706', 'volume_size': 1} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607884230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c6e82c-0c97-4d11-943c-782d72024706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:36Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Creating volume 55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:35 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 1073741824 Sep 29 12:53:35 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:36 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" returned: 0 in 0.384s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:36 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a Sep 29 12:53:36 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:36 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 1073741824" returned: 0 in 0.469s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:36 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 Sep 29 12:53:36 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:36 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a" returned: 0 in 0.349s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:36 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a Sep 29 12:53:36 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:36 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706" returned: 0 in 0.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cbefdb-4be5-4e7f-8019-a4d2887a260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c6e82c-0c97-4d11-943c-782d72024706', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e52c74e-1b8c-408d-bbdf-9737669276da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Volume volume-55c6e82c-0c97-4d11-943c-782d72024706 (55c6e82c-0c97-4d11-943c-782d72024706): created successfully Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e52c74e-1b8c-408d-bbdf-9737669276da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (00c0b5e7-2b82-48e0-94e0-d92016cd5eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5d64a69f-da04-405c-9dda-c3212dd8806f tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:36 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492.6b60ddd5-f02c-4384-ac71-98b19d541d8a" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-6b60ddd5-f02c-4384-ac71-98b19d541d8a" released by "_delete_snapshot" :: held 1.516s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" released by "delete_snapshot" :: held 1.541s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Created reservations ['017da16d-1cfe-4fc2-8b16-ef3ffc012820', '44ff7e2c-8f6d-426f-845d-d4d16768ca88', '61a34496-dd70-449a-a16f-5ddfae9d62ae', 'd194ffd6-bacd-417a-8371-98c5efee9167'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Delete snapshot completed successfully. Sep 29 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a333c8e-f042-4204-a4da-ac5024842afb tempest-ProjectReaderTests-740467961 None] Lock "cinder-6b60ddd5-f02c-4384-ac71-98b19d541d8a-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-e797b5b9-ced1-4a2b-b44a-3c8bdea67492-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "cinder-e797b5b9-ced1-4a2b-b44a-3c8bdea67492-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Acquiring lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc1e50-ddff-490c-83ae-a8dcce241fe8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:37 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 Sep 29 12:53:37 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:37 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" returned: 0 in 0.376s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:37 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492 Sep 29 12:53:37 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot ac0bf78d-f3b8-400b-821b-83cd77e0fd40 of volume 55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9e9f1-0d92-4436-bce7-7cf2a9c82760]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:38 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "cinder-quobyte-e797b5b9-ced1-4a2b-b44a-3c8bdea67492" released by "delete_volume" :: held 0.694s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:38 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 Sep 29 12:53:38 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Created reservations ['6f378c68-d61e-4378-882f-a4dbc1dc3c56', '31518103-52c2-4c9b-bfc4-e6eef7cff0b0', 'ffd2223c-a71c-43fb-98d7-c6fd6c639100', 'd25cc3e0-d21c-43f1-9d12-bf93844c7b4b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:38 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:38 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:38 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706" returned: 0 in 0.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:38 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 1G Sep 29 12:53:38 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:38 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Deleted volume successfully. Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63afb620-ddfd-476d-a6c4-977d3ca5f722 tempest-ProjectReaderTests-740467961 None] Lock "cinder-e797b5b9-ced1-4a2b-b44a-3c8bdea67492-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:38 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 1G" returned: 0 in 0.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c6e82c-0c97-4d11-943c-782d72024706 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:38 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c6e82c-0c97-4d11-943c-782d72024706 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 Sep 29 12:53:38 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:39 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c6e82c-0c97-4d11-943c-782d72024706 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40" returned: 0 in 0.307s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:39 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 is being set with open permissions: ugo+rw Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:39 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 Sep 29 12:53:39 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:39 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:39 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info Sep 29 12:53:39 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:39 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info" returned: 0 in 0.294s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:39 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info is being set with open permissions: ugo+rw Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:39 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info Sep 29 12:53:39 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:39 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.info" returned: 0 in 0.279s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-45c8b191-e3f1-42d2-865c-0ec0bc178eac tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-ac0bf78d-f3b8-400b-821b-83cd77e0fd40-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-ac0bf78d-f3b8-400b-821b-83cd77e0fd40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-ac0bf78d-f3b8-400b-821b-83cd77e0fd40" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-ac0bf78d-f3b8-400b-821b-83cd77e0fd40" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot ac0bf78d-f3b8-400b-821b-83cd77e0fd40 of volume 55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f362c1-4a35-43fa-9752-2cb7c945224e]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:41 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 Sep 29 12:53:41 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:41 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40" returned: 0 in 0.380s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55c6e82c-0c97-4d11-943c-782d72024706(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[625395f6-e0fc-43f3-bd0f-b024d2968175]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:41 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 Sep 29 12:53:41 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:42 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706" returned: 0 in 0.405s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:42 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 Sep 29 12:53:42 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:42 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:42 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40 Sep 29 12:53:42 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:42 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706.ac0bf78d-f3b8-400b-821b-83cd77e0fd40" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-ac0bf78d-f3b8-400b-821b-83cd77e0fd40" released by "_delete_snapshot" :: held 1.553s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" released by "delete_snapshot" :: held 1.578s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Created reservations ['350621de-ec20-4a7c-9159-7dd30f4e4456', '776676c9-0e6a-4090-9cc2-e5e2cf058f46', '7fc6da32-f694-4d81-a024-6da34f2aac3d', '24c429f0-5fa6-4087-aada-9d43295ea351'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5daaba5f-0824-4065-acc1-9ce863214167 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-ac0bf78d-f3b8-400b-821b-83cd77e0fd40-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-55c6e82c-0c97-4d11-943c-782d72024706-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-55c6e82c-0c97-4d11-943c-782d72024706-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[38471d44-8094-49d3-91c7-4154bc5bdece]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:43 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 Sep 29 12:53:43 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:43 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706" returned: 0 in 0.390s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:43 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706 Sep 29 12:53:43 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:44 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-55c6e82c-0c97-4d11-943c-782d72024706" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-55c6e82c-0c97-4d11-943c-782d72024706" released by "delete_volume" :: held 0.733s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Created reservations ['7a964190-2f8d-4409-a232-72e4b9e315d1', 'bf55af40-07e4-4278-b2d6-c06f1eda3ac2', '79c6a0f6-d365-471f-a39b-ce5d42a6975e', '89a72883-34f1-4819-9b40-408a4fbac4a2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:44 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:44 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:44 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3424780-4837-49ec-9853-b269c13d54b6 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-55c6e82c-0c97-4d11-943c-782d72024706-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (0288d3d4-ad69-4760-a1e1-39d8d9d0bfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0643938-81b4-4dac-b142-169a5adb214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0643938-81b4-4dac-b142-169a5adb214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751911793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5d60de-04a8-47b2-9721-f5d040135a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:45Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce09fe2-a149-47e7-afa5-ab1967c16c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce09fe2-a149-47e7-afa5-ab1967c16c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c0533f-a0f4-4ac8-bcd8-79e21a88156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c0533f-a0f4-4ac8-bcd8-79e21a88156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5d60de-04a8-47b2-9721-f5d040135a51', 'volume_name': 'volume-5e5d60de-04a8-47b2-9721-f5d040135a51', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713c693c-9998-482f-bd92-cc5e83dd8363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713c693c-9998-482f-bd92-cc5e83dd8363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d60693-e322-4d67-9a4a-eca7eec108c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Volume 5e5d60de-04a8-47b2-9721-f5d040135a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5d60de-04a8-47b2-9721-f5d040135a51', 'volume_size': 1} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751911793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5d60de-04a8-47b2-9721-f5d040135a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:45Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Creating volume 5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:44 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 1073741824 Sep 29 12:53:44 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:45 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 1073741824" returned: 0 in 0.610s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:45 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 Sep 29 12:53:45 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:45 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d60693-e322-4d67-9a4a-eca7eec108c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5d60de-04a8-47b2-9721-f5d040135a51', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf9eec6-32e7-4bac-8d46-7600ea6d721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Volume volume-5e5d60de-04a8-47b2-9721-f5d040135a51 (5e5d60de-04a8-47b2-9721-f5d040135a51): created successfully Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf9eec6-32e7-4bac-8d46-7600ea6d721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (0288d3d4-ad69-4760-a1e1-39d8d9d0bfdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6143a6fc-bf90-48cd-a2c4-3589bb0732b8 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=245,cinder:SELECT=178,cinder:INSERT=71,cinder:DELETE=22 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=202,cinder:UPDATE=241,cinder:INSERT=62,cinder:DELETE=18 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot 6ff66737-041a-4946-842e-0306c07bcc8c of volume 5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4790fc5-51da-4814-b37d-62ad59473912]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:47 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 Sep 29 12:53:47 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:47 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51" returned: 0 in 0.376s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:47 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c 1G Sep 29 12:53:47 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:48 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c 1G" returned: 0 in 0.457s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5d60de-04a8-47b2-9721-f5d040135a51 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:48 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5d60de-04a8-47b2-9721-f5d040135a51 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c Sep 29 12:53:48 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:48 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5d60de-04a8-47b2-9721-f5d040135a51 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c" returned: 0 in 0.295s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:48 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c is being set with open permissions: ugo+rw Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:48 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c Sep 29 12:53:48 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:48 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:48 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info Sep 29 12:53:48 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:48 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info" returned: 0 in 0.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:48 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info is being set with open permissions: ugo+rw Sep 29 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:48 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info Sep 29 12:53:48 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:49 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.info" returned: 0 in 0.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6a6e1e62-b6f3-423c-86f4-e4ab124be505 tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-6ff66737-041a-4946-842e-0306c07bcc8c-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-6ff66737-041a-4946-842e-0306c07bcc8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-6ff66737-041a-4946-842e-0306c07bcc8c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-6ff66737-041a-4946-842e-0306c07bcc8c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot 6ff66737-041a-4946-842e-0306c07bcc8c of volume 5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a380a9c-3602-4f0e-956f-4d50c4c32e38]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:50 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c Sep 29 12:53:50 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:50 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5d60de-04a8-47b2-9721-f5d040135a51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b769f-d170-4a91-8180-1507defe909d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:51 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 Sep 29 12:53:51 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:51 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51" returned: 0 in 0.442s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:51 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c Sep 29 12:53:51 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:51 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c" returned: 0 in 0.379s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:51 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c Sep 29 12:53:51 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:51 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51.6ff66737-041a-4946-842e-0306c07bcc8c" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-6ff66737-041a-4946-842e-0306c07bcc8c" released by "_delete_snapshot" :: held 1.623s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" released by "delete_snapshot" :: held 1.647s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Created reservations ['e19e2e23-e144-4b25-8be7-c9856e3c7caf', 'b50d4294-beab-43d0-9d11-ded66def8147', 'c61c1a23-07f9-4b37-8bec-1fd24944e2f6', '597827a0-e929-4ab6-bb33-76f40df04f85'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f78146b-baff-4c40-80c6-bc0afbe8ac34 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-6ff66737-041a-4946-842e-0306c07bcc8c-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-5e5d60de-04a8-47b2-9721-f5d040135a51-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "cinder-5e5d60de-04a8-47b2-9721-f5d040135a51-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[857474a4-d4fe-442b-8bf2-0c56d22ce82a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:52 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 Sep 29 12:53:52 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:53 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51" returned: 0 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:53 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51 Sep 29 12:53:53 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:53 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-5e5d60de-04a8-47b2-9721-f5d040135a51" returned: 0 in 0.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-5e5d60de-04a8-47b2-9721-f5d040135a51" released by "delete_volume" :: held 0.737s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Created reservations ['a5f53966-126e-4215-adb0-b2ddf94804e4', 'b83a39ee-3dcd-4eb9-b6f0-0e5b168be64e', '1e31b821-99f6-47a5-bf07-f8edd9f70cc0', '16c25c05-5861-452b-81c6-c1e7d129fa2a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:53 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:53:53 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:53 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:53:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:53:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2585d8dc-5218-4ff4-af78-9305501012cb tempest-ProjectMemberTests-1564258649 None] Lock "cinder-5e5d60de-04a8-47b2-9721-f5d040135a51-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (72459599-df3b-4dd9-82dd-1e46ad58d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eca3101-e1e9-44ea-9e5b-a8ffef78d0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eca3101-e1e9-44ea-9e5b-a8ffef78d0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995365822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be1d9b3-2d4f-42af-b8da-b6ee9083c897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:54Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d44c997-e5a5-4d80-9247-99aa99b1777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d44c997-e5a5-4d80-9247-99aa99b1777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea7c4ae-fcb8-4291-868d-4ea5ba00948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea7c4ae-fcb8-4291-868d-4ea5ba00948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be1d9b3-2d4f-42af-b8da-b6ee9083c897', 'volume_name': 'volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2529a8-7f80-400d-8564-8eb4d7d74476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2529a8-7f80-400d-8564-8eb4d7d74476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec138fc8-be3d-4b28-b31f-d5eed0c92f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Volume 1be1d9b3-2d4f-42af-b8da-b6ee9083c897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897', 'volume_size': 1} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995365822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be1d9b3-2d4f-42af-b8da-b6ee9083c897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:53:54Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Creating volume 1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:53:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:54 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 1073741824 Sep 29 12:53:54 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:54 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 1073741824" returned: 0 in 0.437s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:54 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 Sep 29 12:53:54 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:55 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec138fc8-be3d-4b28-b31f-d5eed0c92f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07257987-761b-49a8-974f-3e5f3db1ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:53:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Volume volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 (1be1d9b3-2d4f-42af-b8da-b6ee9083c897): created successfully Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07257987-761b-49a8-974f-3e5f3db1ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (72459599-df3b-4dd9-82dd-1e46ad58d287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:53:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4d292a4a-4ca4-4078-901c-4657108ece11 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot 765e5485-307d-4a68-a58f-4612a137fa49 of volume 1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a268fb9-ca42-4300-906a-bb047d340588]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:55 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 Sep 29 12:53:55 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:55 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" returned: 0 in 0.394s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:55 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 1G Sep 29 12:53:55 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:56 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 1G" returned: 0 in 0.518s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:56 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 Sep 29 12:53:56 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:56 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49" returned: 0 in 0.350s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:56 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 is being set with open permissions: ugo+rw Sep 29 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:56 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 Sep 29 12:53:56 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:56 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49" returned: 0 in 0.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:57 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info Sep 29 12:53:57 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:57 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info is being set with open permissions: ugo+rw Sep 29 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:57 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info Sep 29 12:53:57 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:57 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.info" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:53:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-25fdcf09-55fe-48b0-9e76-67917bfe23fe tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-765e5485-307d-4a68-a58f-4612a137fa49-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-765e5485-307d-4a68-a58f-4612a137fa49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-765e5485-307d-4a68-a58f-4612a137fa49" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-765e5485-307d-4a68-a58f-4612a137fa49" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot 765e5485-307d-4a68-a58f-4612a137fa49 of volume 1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0356a3-80fc-491f-bf8e-945199250e39]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:58 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 Sep 29 12:53:58 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:59 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49" returned: 0 in 0.374s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ae40c-60d4-4eb7-af08-c61ece6a1629]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:59 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 Sep 29 12:53:59 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:59 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" returned: 0 in 0.391s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:59 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 Sep 29 12:53:59 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:53:59 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49" returned: 0 in 0.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:53:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:53:59 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49 Sep 29 12:53:59 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:00 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897.765e5485-307d-4a68-a58f-4612a137fa49" returned: 0 in 0.277s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-765e5485-307d-4a68-a58f-4612a137fa49" released by "_delete_snapshot" :: held 1.525s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" released by "delete_snapshot" :: held 1.555s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Created reservations ['e419bdb1-1736-449c-9a8d-44f48a74ea2b', '8ead9215-b859-4071-a64b-f1407f337174', '1eaa9816-759c-4f5c-bce2-8624c36deac0', 'a9ba0509-dbe9-439a-bb75-7b62cef9a2a9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-164c2101-b0f0-4dc1-b3fd-ef117234d588 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-765e5485-307d-4a68-a58f-4612a137fa49-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-1be1d9b3-2d4f-42af-b8da-b6ee9083c897-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-1be1d9b3-2d4f-42af-b8da-b6ee9083c897-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66fc967-93f9-4408-9c5c-024848769161]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:01 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 Sep 29 12:54:01 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:01 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" returned: 0 in 0.407s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:01 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897 Sep 29 12:54:01 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:01 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" returned: 0 in 0.306s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-1be1d9b3-2d4f-42af-b8da-b6ee9083c897" released by "delete_volume" :: held 0.789s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Created reservations ['2e83b945-ef7b-4d95-9997-65b1cd41cbe5', '2c02de51-d1a9-44ae-abb9-6301d491f4e8', '4f169903-89d5-4256-b4f0-5015366c7f7e', '1b7d22db-f76d-4a35-8dbb-45fe68d0b941'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:01 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:01 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:02 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c82734ee-2a62-4da4-ab04-5f2ea97af926 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-1be1d9b3-2d4f-42af-b8da-b6ee9083c897-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (efdcf5af-c1ff-48d7-856b-30b678a0636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fd276f-da33-4cce-b061-5f2d077a394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fd276f-da33-4cce-b061-5f2d077a394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155576494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70d79a6-401e-4405-9c82-6fb00c4e791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:02Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789f2c0f-492e-499a-b633-908568fb7092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789f2c0f-492e-499a-b633-908568fb7092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9206e-d6a1-4ec0-9d88-9a077782dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9206e-d6a1-4ec0-9d88-9a077782dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70d79a6-401e-4405-9c82-6fb00c4e791b', 'volume_name': 'volume-d70d79a6-401e-4405-9c82-6fb00c4e791b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f15256-7a8f-4c67-a72d-44c010f37846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f15256-7a8f-4c67-a72d-44c010f37846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b2ad64-aed0-4646-90d7-371c42131ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Volume d70d79a6-401e-4405-9c82-6fb00c4e791b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70d79a6-401e-4405-9c82-6fb00c4e791b', 'volume_size': 1} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155576494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70d79a6-401e-4405-9c82-6fb00c4e791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5651bd170946cc97251049c6eb7a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:02Z,use_quota=True,user_id='de89732e46364dce91bb3533877e0317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Creating volume d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:02 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b 1073741824 Sep 29 12:54:02 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:03 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b 1073741824" returned: 0 in 0.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:03 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b Sep 29 12:54:03 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:03 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b" returned: 0 in 0.307s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b2ad64-aed0-4646-90d7-371c42131ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70d79a6-401e-4405-9c82-6fb00c4e791b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4a7ff9-7064-42e4-a092-098667880cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Volume volume-d70d79a6-401e-4405-9c82-6fb00c4e791b (d70d79a6-401e-4405-9c82-6fb00c4e791b): created successfully Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4a7ff9-7064-42e4-a092-098667880cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Flow 'volume_create_manager' (efdcf5af-c1ff-48d7-856b-30b678a0636f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-82506969-6340-4fa5-b3b6-be13539d07c6 tempest-ProjectMemberTests-1564258649 None] Created volume successfully. Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Flow 'volume_create_manager' (97825e1d-3b23-4d2e-a54a-550d48623005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae1cd51-b725-4a66-88e0-d2e7bc6c0aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae1cd51-b725-4a66-88e0-d2e7bc6c0aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1631014916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd151f5-4b67-4f18-aba9-e871a347e7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ece2bc5144b46b4acbbe96e266c6810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:04Z,use_quota=True,user_id='57419e3c3e764cc6a5e71081a9d95764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3319efff-e6a5-49fd-9642-77c9ee2413bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3319efff-e6a5-49fd-9642-77c9ee2413bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92758fe6-e166-420d-94f8-a7b7ff123415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92758fe6-e166-420d-94f8-a7b7ff123415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd151f5-4b67-4f18-aba9-e871a347e7a5', 'volume_name': 'volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d53025-dfdf-43b9-82e2-fae128641e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d53025-dfdf-43b9-82e2-fae128641e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f197923b-804b-4e72-936a-ad3090e6508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Volume ffd151f5-4b67-4f18-aba9-e871a347e7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5', 'volume_size': 1} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1631014916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd151f5-4b67-4f18-aba9-e871a347e7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ece2bc5144b46b4acbbe96e266c6810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:04Z,use_quota=True,user_id='57419e3c3e764cc6a5e71081a9d95764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Creating volume ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:04 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:04 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 1073741824 Sep 29 12:54:04 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:04 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 1073741824" returned: 0 in 0.473s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:04 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:04 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:05 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f197923b-804b-4e72-936a-ad3090e6508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d17276-c856-431d-8797-4ad68741af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Creating offline snapshot ad80cb5a-1c9c-4cd9-8bc7-275da352401e of volume d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:54:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Volume volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 (ffd151f5-4b67-4f18-aba9-e871a347e7a5): created successfully Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d17276-c856-431d-8797-4ad68741af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Flow 'volume_create_manager' (97825e1d-3b23-4d2e-a54a-550d48623005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31bf290-c471-4bb4-8470-eab7048e4d00]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-72d27673-9531-4d08-a796-dc35029de288 tempest-SnapshotDependencyTests-1642723324 None] Created volume successfully. Sep 29 12:54:05 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b Sep 29 12:54:05 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:05 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b" returned: 0 in 0.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:05 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e 1G Sep 29 12:54:05 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:05 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e 1G" returned: 0 in 0.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70d79a6-401e-4405-9c82-6fb00c4e791b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:06 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70d79a6-401e-4405-9c82-6fb00c4e791b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e Sep 29 12:54:06 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:06 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d70d79a6-401e-4405-9c82-6fb00c4e791b -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e" returned: 0 in 0.289s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:06 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e is being set with open permissions: ugo+rw Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:06 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e Sep 29 12:54:06 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:06 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e" returned: 0 in 0.245s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:06 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info Sep 29 12:54:06 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:06 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info" returned: 0 in 0.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:06 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info is being set with open permissions: ugo+rw Sep 29 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:06 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info Sep 29 12:54:06 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:07 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.info" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.512s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Creating offline snapshot e8413049-ac55-4211-9215-0190fc438c5a of volume ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:54:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-63dde651-013a-4fff-b47d-fcafaa6b2814 tempest-ProjectMemberTests-1564258649 None] Create snapshot completed successfully Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4e0ba7-936e-4c25-b4bb-d55da56c5603]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:07 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:07 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:07 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.363s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:07 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a 1G Sep 29 12:54:07 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:07 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a 1G" returned: 0 in 0.401s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:07 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:07 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-ad80cb5a-1c9c-4cd9-8bc7-275da352401e-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-ad80cb5a-1c9c-4cd9-8bc7-275da352401e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-ad80cb5a-1c9c-4cd9-8bc7-275da352401e" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-ad80cb5a-1c9c-4cd9-8bc7-275da352401e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Deleting offline snapshot ad80cb5a-1c9c-4cd9-8bc7-275da352401e of volume d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] snapshot_file for this snap is: volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712d9c9-2621-4ba1-af4d-45c6a5e8dbc8]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:08 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 -F qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.327s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:08 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a is being set with open permissions: ugo+rw Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:08 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:08 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:08 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e Sep 29 12:54:08 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:08 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:08 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info Sep 29 12:54:08 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:08 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d70d79a6-401e-4405-9c82-6fb00c4e791b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c9650-5d27-44a6-9634-2a3b0878facd]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:08 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b Sep 29 12:54:08 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:08 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info" returned: 0 in 0.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:08 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info is being set with open permissions: ugo+rw Sep 29 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:08 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info Sep 29 12:54:08 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:09 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b" returned: 0 in 0.371s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:09 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e Sep 29 12:54:09 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:09 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.info" returned: 0 in 0.258s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c98887eb-b581-4cb3-b751-5a2df68e99bf tempest-SnapshotDependencyTests-1642723324 None] Create snapshot completed successfully Sep 29 12:54:09 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e" returned: 0 in 0.340s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:09 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e Sep 29 12:54:09 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:09 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b.ad80cb5a-1c9c-4cd9-8bc7-275da352401e" returned: 0 in 0.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-ad80cb5a-1c9c-4cd9-8bc7-275da352401e" released by "_delete_snapshot" :: held 1.461s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" released by "delete_snapshot" :: held 1.485s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Created reservations ['eb9ccd17-83ba-4a3f-be49-6bdaf2a29446', '973eb88c-86c9-4628-9ab3-822588b4dbfc', '9e9593d2-d488-46a4-bc8d-bb09239bffd0', '63a67552-c7d6-49f4-8ff3-7861b350f5ce'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Delete snapshot completed successfully. Sep 29 12:54:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-540ce542-3158-4fca-a328-831587196730 tempest-ProjectMemberTests-1564258649 None] Lock "cinder-ad80cb5a-1c9c-4cd9-8bc7-275da352401e-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-d70d79a6-401e-4405-9c82-6fb00c4e791b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "cinder-d70d79a6-401e-4405-9c82-6fb00c4e791b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Flow 'volume_create_manager' (513ec5e0-0204-4c79-88cc-41957e437884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12693e60-042f-4b98-b849-e9b90eb6d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12693e60-042f-4b98-b849-e9b90eb6d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b6eff5-9be9-4ec1-be81-6780ee1e1349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ece2bc5144b46b4acbbe96e266c6810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8413049-ac55-4211-9215-0190fc438c5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:10Z,use_quota=True,user_id='57419e3c3e764cc6a5e71081a9d95764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a89883-90a3-4fa3-964a-2a1d8169fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a89883-90a3-4fa3-964a-2a1d8169fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6c65e1-0c7a-4c8d-ac6e-f315d2ef7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6c65e1-0c7a-4c8d-ac6e-f315d2ef7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01b6eff5-9be9-4ec1-be81-6780ee1e1349', 'volume_name': 'volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349', 'volume_size': 1, 'snapshot_id': 'e8413049-ac55-4211-9215-0190fc438c5a'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dc12c4-b575-49e3-b5dd-781d5f5d8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dc12c4-b575-49e3-b5dd-781d5f5d8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac6020f-29bc-4705-8432-1b6d60b16a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Volume 01b6eff5-9be9-4ec1-be81-6780ee1e1349: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349', 'volume_size': 1, 'snapshot_id': 'e8413049-ac55-4211-9215-0190fc438c5a'} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Acquiring lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a-01b6eff5-9be9-4ec1-be81-6780ee1e1349" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a-01b6eff5-9be9-4ec1-be81-6780ee1e1349" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Creating volume 01b6eff5-9be9-4ec1-be81-6780ee1e1349 from snapshot e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b8403-3156-4b79-817e-84a895797456]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] snapshot: e8413049-ac55-4211-9215-0190fc438c5a, volume: 01b6eff5-9be9-4ec1-be81-6780ee1e1349, {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[61599b74-cacc-4e3f-80bc-0643a889b6a0]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:10 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b Sep 29 12:54:10 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:10 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:10 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:10 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b" returned: 0 in 0.388s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:10 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b Sep 29 12:54:10 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:10 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.389s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3409703-de5e-422e-8f85-4f86b45bac8d]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:11 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:11 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:11 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-d70d79a6-401e-4405-9c82-6fb00c4e791b" returned: 0 in 0.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "cinder-quobyte-d70d79a6-401e-4405-9c82-6fb00c4e791b" released by "delete_volume" :: held 0.728s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Created reservations ['9081deca-6c00-4a0c-9066-24b0daddb226', 'c1cee028-bccd-4352-b76b-09224bbd36b3', 'b1facea3-e7f0-4ecd-bba3-b50e32f73c97', '03510441-0a05-43d6-9949-823045d91395'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:11 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:11 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:11 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.396s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Path /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:11 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 Sep 29 12:54:11 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:11 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Deleted volume successfully. Sep 29 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f3e1fe44-ab76-4baf-9d2f-326816f1c6df tempest-ProjectMemberTests-1564258649 None] Lock "cinder-d70d79a6-401e-4405-9c82-6fb00c4e791b-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:18 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349" returned: 0 in 6.826s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Image conversion details: src /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:54:18 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Converted 1024.00 MB image at 150.00 MB/s Sep 29 12:54:18 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 is being set with open permissions: ugo+rw Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:18 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 Sep 29 12:54:18 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:18 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349" returned: 0 in 0.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" released by "_copy_volume_from_snapshot" :: held 7.962s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a-01b6eff5-9be9-4ec1-be81-6780ee1e1349" released by "_create_volume_from_snapshot" :: held 8.049s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.103s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac6020f-29bc-4705-8432-1b6d60b16a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349', 'volume_size': 1, 'snapshot_id': 'e8413049-ac55-4211-9215-0190fc438c5a'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5dd8b5-5d01-42e4-a819-649e216d1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Volume volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 (01b6eff5-9be9-4ec1-be81-6780ee1e1349): created successfully Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5dd8b5-5d01-42e4-a819-649e216d1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Flow 'volume_create_manager' (513ec5e0-0204-4c79-88cc-41957e437884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a77e972b-e44d-4b54-9a63-1df58ebab8c9 tempest-SnapshotDependencyTests-1642723324 None] Created volume successfully. Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-e8413049-ac55-4211-9215-0190fc438c5a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-e8413049-ac55-4211-9215-0190fc438c5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Deleting offline snapshot e8413049-ac55-4211-9215-0190fc438c5a of volume ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] snapshot_file for this snap is: volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bbb19d-93df-4682-a236-1ea02862b249]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:19 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:19 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:19 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.403s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a755c0-3eec-4120-8a77-20d31a27675a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:19 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:19 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:20 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.578s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:20 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:20 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:20 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:20 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a Sep 29 12:54:20 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:20 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5.e8413049-ac55-4211-9215-0190fc438c5a" returned: 0 in 0.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-e8413049-ac55-4211-9215-0190fc438c5a" released by "_delete_snapshot" :: held 1.739s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" released by "delete_snapshot" :: held 1.764s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Created reservations ['d4dd50c4-ae1c-4e06-97cd-ce11b1e7cec3', '7196a557-d11a-42cc-8b61-3b73ac85f5bd', '9f79fe4d-8ae7-4757-b015-33fce3f7b16d', '004604eb-587c-439d-8895-29e9ffbe78b1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Delete snapshot completed successfully. Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-732e6a07-ed62-4126-9fa2-6f64e772f82c tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-e8413049-ac55-4211-9215-0190fc438c5a-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-ffd151f5-4b67-4f18-aba9-e871a347e7a5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-ffd151f5-4b67-4f18-aba9-e871a347e7a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6a9f68-c313-4c29-8778-9080019943da]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:21 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:21 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:21 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.380s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:21 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5 Sep 29 12:54:21 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:22 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-ffd151f5-4b67-4f18-aba9-e871a347e7a5" returned: 0 in 0.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-ffd151f5-4b67-4f18-aba9-e871a347e7a5" released by "delete_volume" :: held 0.721s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Created reservations ['a7eaf4b9-b1b9-40af-8eae-69fb1533e45e', 'dcaa6933-9dbb-4080-88f3-57caf3a37e18', '02f6780d-250d-40ab-b3ff-bd2b1614f957', '2dad3a14-49de-4206-89b3-adfef4917dec'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:22 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:22 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-01b6eff5-9be9-4ec1-be81-6780ee1e1349-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:22 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-01b6eff5-9be9-4ec1-be81-6780ee1e1349-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.291s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Deleted volume successfully. Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-41b38fdc-f14d-4a5c-aa40-0557dd2ab786 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-ffd151f5-4b67-4f18-aba9-e871a347e7a5-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef2df72-32b8-43b7-b90f-b56fa2a6a52c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:22 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 Sep 29 12:54:22 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:23 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349" returned: 0 in 0.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:23 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349 Sep 29 12:54:23 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:23 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-01b6eff5-9be9-4ec1-be81-6780ee1e1349" returned: 0 in 0.241s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-quobyte-01b6eff5-9be9-4ec1-be81-6780ee1e1349" released by "delete_volume" :: held 0.662s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Created reservations ['ca736044-aaf6-4077-b4f2-12b79009c167', '161e5a25-9c7e-44dd-aaf0-8a535ac117e2', '5eade087-3ea5-4f5a-9a05-ce2bd636cb16', '005bde99-4088-4a8c-ade4-91b846cc1d33'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:23 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:23 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:23 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.258s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Deleted volume successfully. Sep 29 12:54:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c1968f14-f75f-49c7-a4ce-c2ac40eebb91 tempest-SnapshotDependencyTests-1642723324 None] Lock "cinder-01b6eff5-9be9-4ec1-be81-6780ee1e1349-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (81fbc559-72d2-4f53-9bc1-ca777b0645e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2454ddfb-3c94-418b-8636-e9e32e3580b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2454ddfb-3c94-418b-8636-e9e32e3580b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-715066338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c445a-1ae2-4c52-a667-7e8137b6da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:27Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e27d52-8e3d-4a92-b9e2-3778c9856e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e27d52-8e3d-4a92-b9e2-3778c9856e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6814a1e-28f0-409d-84b2-57d88a98b017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6814a1e-28f0-409d-84b2-57d88a98b017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36c445a-1ae2-4c52-a667-7e8137b6da76', 'volume_name': 'volume-e36c445a-1ae2-4c52-a667-7e8137b6da76', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349effdb-e2b3-4f9b-bc06-c2641fdd4a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349effdb-e2b3-4f9b-bc06-c2641fdd4a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5381e8b4-bce6-495c-97dc-5222e68f90b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Volume e36c445a-1ae2-4c52-a667-7e8137b6da76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36c445a-1ae2-4c52-a667-7e8137b6da76', 'volume_size': 1} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-715066338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c445a-1ae2-4c52-a667-7e8137b6da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:27Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Creating volume e36c445a-1ae2-4c52-a667-7e8137b6da76 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:27 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:27 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 1073741824 Sep 29 12:54:27 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:27 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 1073741824" returned: 0 in 0.520s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:27 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 Sep 29 12:54:27 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:28 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76" returned: 0 in 0.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5381e8b4-bce6-495c-97dc-5222e68f90b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36c445a-1ae2-4c52-a667-7e8137b6da76', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c53aa96-8f51-4aef-a477-bc1075ae15fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Volume volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 (e36c445a-1ae2-4c52-a667-7e8137b6da76): created successfully Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c53aa96-8f51-4aef-a477-bc1075ae15fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (81fbc559-72d2-4f53-9bc1-ca777b0645e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-df0e9ff5-81f5-4eda-b664-3c0fbaa55b9e tempest-ProjectReaderTests-1320899520 None] Created volume successfully. Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-e36c445a-1ae2-4c52-a667-7e8137b6da76-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "cinder-e36c445a-1ae2-4c52-a667-7e8137b6da76-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-quobyte-e36c445a-1ae2-4c52-a667-7e8137b6da76" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-e36c445a-1ae2-4c52-a667-7e8137b6da76" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2cdb12-bc4d-4a33-85da-4cb3211af91a]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:29 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 Sep 29 12:54:29 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:29 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76" returned: 0 in 0.394s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:29 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76 Sep 29 12:54:29 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:30 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-e36c445a-1ae2-4c52-a667-7e8137b6da76" returned: 0 in 0.254s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-e36c445a-1ae2-4c52-a667-7e8137b6da76" released by "delete_volume" :: held 0.706s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Created reservations ['8b602b52-33b2-4757-b98a-084e29785520', '3d711edc-281c-4528-b462-6403d915f5f8', '73f56e42-f826-4908-a2c8-0b97aaa3e0ad', '45617483-dd39-4967-8830-9a67982de944'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:30 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:30 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:30 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:30 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:30 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.429s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] Running periodic task VolumeManager._thread_info {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread count: 28 {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:54:30 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a8e43278-4fe7-4107-9a89-c749cfc92b43 None None] thread info: [<_MainThread(MainThread, started 134281367064704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Deleted volume successfully. Sep 29 12:54:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3daf60c1-030a-4c17-9fd9-f108b23547ba tempest-ProjectReaderTests-1320899520 None] Lock "cinder-e36c445a-1ae2-4c52-a667-7e8137b6da76-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (cea7edf6-651c-4fc9-aabf-9597b42eea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c0986c-b379-4cc4-93df-aeade917a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c0986c-b379-4cc4-93df-aeade917a91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848361808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efc644-ac71-43c4-a064-c64835ed3265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:31Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6633b0eb-0099-415d-8c8b-92158c909866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6633b0eb-0099-415d-8c8b-92158c909866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f769417-bb3d-4234-a974-7282b89b1362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f769417-bb3d-4234-a974-7282b89b1362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0efc644-ac71-43c4-a064-c64835ed3265', 'volume_name': 'volume-f0efc644-ac71-43c4-a064-c64835ed3265', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2d353b-fb4a-42f5-be78-518d187db21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2d353b-fb4a-42f5-be78-518d187db21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d26b09-7033-48bf-a6b7-c3e570c915b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Volume f0efc644-ac71-43c4-a064-c64835ed3265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0efc644-ac71-43c4-a064-c64835ed3265', 'volume_size': 1} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848361808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efc644-ac71-43c4-a064-c64835ed3265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:31Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Creating volume f0efc644-ac71-43c4-a064-c64835ed3265 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:31 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:31 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 1073741824 Sep 29 12:54:31 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:31 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 1073741824" returned: 0 in 0.426s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:31 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 Sep 29 12:54:31 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:31 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265" returned: 0 in 0.245s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d26b09-7033-48bf-a6b7-c3e570c915b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0efc644-ac71-43c4-a064-c64835ed3265', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca69f1f8-2130-4cd5-9530-66b6f74b4d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Volume volume-f0efc644-ac71-43c4-a064-c64835ed3265 (f0efc644-ac71-43c4-a064-c64835ed3265): created successfully Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca69f1f8-2130-4cd5-9530-66b6f74b4d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (cea7edf6-651c-4fc9-aabf-9597b42eea2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4214a644-9490-4b39-8ae7-1447571e7c01 tempest-ProjectReaderTests-1320899520 None] Created volume successfully. Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-f0efc644-ac71-43c4-a064-c64835ed3265-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-f0efc644-ac71-43c4-a064-c64835ed3265-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-quobyte-f0efc644-ac71-43c4-a064-c64835ed3265" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-f0efc644-ac71-43c4-a064-c64835ed3265" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[506ce665-b539-4a53-8ff4-96ff2fc553a6]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:32 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 Sep 29 12:54:32 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:32 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265" returned: 0 in 0.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:32 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265 Sep 29 12:54:32 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:33 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-f0efc644-ac71-43c4-a064-c64835ed3265" returned: 0 in 0.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-f0efc644-ac71-43c4-a064-c64835ed3265" released by "delete_volume" :: held 0.770s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Created reservations ['c9574cb6-ba6e-4443-a4c7-7ac5de468acf', '02252299-510c-4a94-9d57-7fd560c2e8be', 'c4651342-1553-4250-a1f3-011fdf64b7ca', 'c598d55d-40a9-46b4-85d8-f50ab89e1367'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:33 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:33 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:33 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Deleted volume successfully. Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d3080400-2fe5-4785-8bd6-b5957bf74474 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-f0efc644-ac71-43c4-a064-c64835ed3265-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (5307c33a-215d-4e5e-a278-6d096ad04f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b34eb0-cf78-45c4-b01f-5cbcaccd5a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b34eb0-cf78-45c4-b01f-5cbcaccd5a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214729004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6844b94-cb35-44de-a218-ff44064e448f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:34Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951a1fbf-b604-410d-a327-f398c181a76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951a1fbf-b604-410d-a327-f398c181a76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e1264-85b6-4828-8e01-2bfcfdfbd084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e1264-85b6-4828-8e01-2bfcfdfbd084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6844b94-cb35-44de-a218-ff44064e448f', 'volume_name': 'volume-c6844b94-cb35-44de-a218-ff44064e448f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ddac0b-51c7-4776-a549-2611ac4c4081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ddac0b-51c7-4776-a549-2611ac4c4081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b148dacf-a6f4-4771-9316-adb99747220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Volume c6844b94-cb35-44de-a218-ff44064e448f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6844b94-cb35-44de-a218-ff44064e448f', 'volume_size': 1} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214729004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6844b94-cb35-44de-a218-ff44064e448f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:34Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Creating volume c6844b94-cb35-44de-a218-ff44064e448f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:34 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f 1073741824 Sep 29 12:54:34 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:34 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f 1073741824" returned: 0 in 0.468s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:34 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f Sep 29 12:54:34 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:34 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f" returned: 0 in 0.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b148dacf-a6f4-4771-9316-adb99747220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6844b94-cb35-44de-a218-ff44064e448f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f8b6a6-8919-4008-b3b9-be145931cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Volume volume-c6844b94-cb35-44de-a218-ff44064e448f (c6844b94-cb35-44de-a218-ff44064e448f): created successfully Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f8b6a6-8919-4008-b3b9-be145931cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (5307c33a-215d-4e5e-a278-6d096ad04f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ee031d0-2446-482a-9d44-1bfd4a869cb1 tempest-ProjectReaderTests-1320899520 None] Created volume successfully. Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-c6844b94-cb35-44de-a218-ff44064e448f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-c6844b94-cb35-44de-a218-ff44064e448f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-quobyte-c6844b94-cb35-44de-a218-ff44064e448f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-c6844b94-cb35-44de-a218-ff44064e448f" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e01c3f-3cd0-4920-af72-1786554a405c]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:36 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f Sep 29 12:54:36 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:36 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f" returned: 0 in 0.392s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:36 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f Sep 29 12:54:36 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:36 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-c6844b94-cb35-44de-a218-ff44064e448f" returned: 0 in 0.262s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-c6844b94-cb35-44de-a218-ff44064e448f" released by "delete_volume" :: held 0.700s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Created reservations ['eb3ceb32-fbbc-4b21-ba7b-39aadba74aca', '2378185e-7425-431b-9726-42ae27ed9ebe', 'c52d34b9-5158-4188-b2e7-8b5009942bd7', 'c9e9c7cf-d5e8-4887-91b9-3ccde386c335'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:36 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:36 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:37 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.264s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Deleted volume successfully. Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fef5361c-68d9-43ca-8d19-7e8a0bb04d53 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-c6844b94-cb35-44de-a218-ff44064e448f-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (66a2875d-3307-49ff-867a-9c8b5e36f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0dd00d-b625-40da-9f9e-0e284f8c4228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0dd00d-b625-40da-9f9e-0e284f8c4228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565274431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36743ca4-5051-4f47-8d5f-e64d201850fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:38Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36f8a3f-fa6e-4233-be7e-0670eba81bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36f8a3f-fa6e-4233-be7e-0670eba81bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c26bf9-f0b8-439f-ba2e-411bb9458994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c26bf9-f0b8-439f-ba2e-411bb9458994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36743ca4-5051-4f47-8d5f-e64d201850fc', 'volume_name': 'volume-36743ca4-5051-4f47-8d5f-e64d201850fc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc8a48e-d849-4422-b450-cdd74633505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc8a48e-d849-4422-b450-cdd74633505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280c1327-de6a-42f1-9dda-29ff7dc8bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Volume 36743ca4-5051-4f47-8d5f-e64d201850fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36743ca4-5051-4f47-8d5f-e64d201850fc', 'volume_size': 1} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565274431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36743ca4-5051-4f47-8d5f-e64d201850fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c091bfcded4498923d8a5bc525b99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:54:38Z,use_quota=True,user_id='748ea6749e544d88b4b19c583f125a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(420e933e-a0b9-4252-87e4-2793f5cc0cf7),volume_type_id=420e933e-a0b9-4252-87e4-2793f5cc0cf7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Creating volume 36743ca4-5051-4f47-8d5f-e64d201850fc {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Selected osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:54:37 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] casted to osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4 Sep 29 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:37 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc 1073741824 Sep 29 12:54:37 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:38 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc 1073741824" returned: 0 in 0.412s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:38 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc Sep 29 12:54:38 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:38 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc" returned: 0 in 0.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280c1327-de6a-42f1-9dda-29ff7dc8bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36743ca4-5051-4f47-8d5f-e64d201850fc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c021909-c428-4ace-8e77-82f975f0138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:54:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Volume volume-36743ca4-5051-4f47-8d5f-e64d201850fc (36743ca4-5051-4f47-8d5f-e64d201850fc): created successfully Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c021909-c428-4ace-8e77-82f975f0138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Flow 'volume_create_manager' (66a2875d-3307-49ff-867a-9c8b5e36f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:54:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1e5b639b-abac-4cad-aee0-c7afc9eb5602 tempest-ProjectReaderTests-1320899520 None] Created volume successfully. Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-36743ca4-5051-4f47-8d5f-e64d201850fc-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-36743ca4-5051-4f47-8d5f-e64d201850fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "cinder-quobyte-36743ca4-5051-4f47-8d5f-e64d201850fc" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-36743ca4-5051-4f47-8d5f-e64d201850fc" acquired by "delete_volume" :: waited 0.012s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b484110-e5b2-442d-89ab-ed861b527f7f]: (4, 'qcow2') {{(pid=88838) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:38 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc Sep 29 12:54:38 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:39 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc" returned: 0 in 0.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:39 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc Sep 29 12:54:39 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:39 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f/volume-36743ca4-5051-4f47-8d5f-e64d201850fc" returned: 0 in 0.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-quobyte-36743ca4-5051-4f47-8d5f-e64d201850fc" released by "delete_volume" :: held 0.643s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Created reservations ['ded51bc2-99e9-4b88-b15a-c7fa5b4e6b0c', '7a9de179-eb0a-46e7-9398-b43d3485fe97', 'd1a2b828-0cc2-484d-87aa-f54821719515', 'f391bf5f-856e-454d-a993-2e6ba687a8d2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74649cd8-1cbc-4524-a144-8ca3ee6891e4'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:54:39 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f Sep 29 12:54:39 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:54:39 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5086b77068e4fad17a0b243873a5cf9f" returned: 0 in 0.254s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:54:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Deleted volume successfully. Sep 29 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5c283552-42bd-4966-8a65-a98607f5e4f9 tempest-ProjectReaderTests-1320899520 None] Lock "cinder-36743ca4-5051-4f47-8d5f-e64d201850fc-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:54:49 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=136,cinder:SELECT=82,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:54:49 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=112,cinder:DELETE=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}